I think what you are looking for is an Open Source project that can take inputs from both Amazon CloudWatch and Google StackDriver; there isn't a huge amount out there at the moment, but I will detail what I know.
I have made the assumption that you know how to import your application telemetry into the solutions below.
Open source solutions ...
Note: I'm not a GCE user yet, the answer is based solely on documentation.
You could be Viewing Audit Logs in the Google Cloud Console, more specifically the Admin Activity logs:
Admin Activity logs contain log entries for API calls or other
administrative actions that modify the configuration or metadata of
resources. For example, the logs record ...
You can't add deny rules to GC firewall. The default policy is Deny. You can only add allow rules - allow everything you need and let everything else get rejected.
Since the ports you need to block are allowed by default, you simply need to remove them. Check the name of the default rule:
gcloud compute firewall-rules list [NAME …] [--regexp=REGEXP, -r ...
I don't know much about Redis/ElasticSearch, but GCS is not really a database-like solution, it is closer to a file storage solution.
If you're looking for database-like storage Google Cloud offers:
If you expect a modest app traffic or alternating high/low traffic it might be more cost-effective (and ...
It seems that my cluster is capped at 3% of maximum utilization, if I
read the units correctly. This makes no sense at all, why isn't it
capable of reaching 100% ?
Why do you think it does make no sense at all?
I ran a few tests that created quite a few pods
What is a few tests?
(each pod running basically an hello world script)
What does this ...
If you cordon and drain the nodepool before deleting it, then you can avoid downtime. I use the following script (shamelessly taken from the lazyweb elsewhere and adapted to my needs):
oldnodes=$(k get no --selector='cloud.google.com/gke-nodepool='$oldpool -o json | jq .items.metadata.name -r | xargs)
kubectl cordon --selector='cloud....
That can be achieved using another gcloud command:
gcloud beta asset search-all-iam-policies --query policy:"roles/owner" --project $your_project_id --flatten="results.policy" --format="csv(bindings.members)"
I looked for that too but I don't think you can as these are the ports used by Google to do LB:
HTTP requests can be load balanced based on port 80 or port 8080. HTTPS requests can be load balanced on port 443.
TCP Proxy Load Balancing supports the following ports: 25, 43, 110, 143, 195, 443, 465, 587, 700, 993, 995, 1883, 5222
From: GCP HTTP(S) LB and GCP ...
We had the similar requirement as there needs to be a set of data cached in a server for serving the application (fast processing) and also by end of the day, we would need to sync the data from the cache server to the origin server.
In the longer run, I would suggest to go for Redis as you can have Redis as an intermediate database (caching) and it will ...
info from: https://cloud.google.com/load-balancing/docs/https#open_ports
The external HTTP(S) load balancers are reverse proxy load balancers. The load balancer terminates incoming connections, and then opens new connections from the load balancer to the backends. The reverse proxy functionality is provided by the Google Front Ends (GFEs).
Yes, it is possible to split the incoming traffic between several GAE app/service versions based on the IP address from which the requests originate. From Splitting traffic across multiple versions:
When you have specified two or more versions for splitting, you must
choose whether to split traffic by using either an IP address or HTTP
cookie. It's ...
You can find the IP addresses of the Travis build machines here. If you add the IP addresses of the Travis infrastructure you use to your whitelisted IPs in Cloud SQL it should work. Keep in mind these IP addresses can change in the future though.
You seem to be confused a bit about how Firestore stores data and what Google is suggesting you do.
What is the problem? You are backing up a bucket inside other bucket.
This is not correct. Firestore stores its data inside some sort of mostly opaque database format. If you are copying this out to a GCS bucket, that really is an export into a different ...
Thank you to the comment from user54 for the answer.
Both of my pasted wget URLs work as long as I'm using the correct value for password. In this case, I needed to use my user's API Token as described in the answer to another question:
Not sure if you sorted this out, but I had to do something similar to get who started the instance so I can badger them into stopping the instance if they are not using it. I put together a Logging query:
resource.type = gce_instance AND (jsonPayload.event_subtype = compute.instances.start OR jsonPayload.event_subtype = compute.instances.insert ) AND ...
Given that you mentioned rarely using some k8s resources, you could explore some alternatives:
With gcloud SDK you could create scripts to be executed for the periods you want to reduce GKE nodes (even to zero) during periods you're not using it
With Google Cloud Functions (GCF) you can create some python/Node.js/Go script to access GKE APIs and also ...
Try to use only n1-standard-1 nodes and let the autoscaler do it's magic.
If you can accept some downtime (and eventually some failures of the CI/CD jobs that should be fixed when you retry) you can use preemptible nodes.
Migrate stateless apps to Cloud Run.
Follow this guide to reduce resource consumption on your cluster.
According to "TPU types and zones" TPUs are only available in a very limited set of regions, namely:
Europe, Middle East and Africa
europe-west4-a (Eemshaven, Netherlands)
us-central1-a, b, c and f (Council Bluffs, Iowa, USA)
asia-east1-c (Changhua County, Taiwan)
Note: not every SKU is available in each region, so double check ...
You run the command with the user shishir9159_gmail_com but the error shows firstname.lastname@example.org: Permission denied ... seems like the _gmail_com portion of the username is truncated. Can you try setting the ansible_user config parameter in your inventory file or playbook rather than passing it on via the CLI?
I contacted the support of Google Cloud about this question and they told me that Cloud SQL isn't build to perform this change without downtime. If I want to be able to make these changes, I should look at Cloud Spanner which is a horizontal scalable SQL solution provided by Google.
Most probably, you are using the wrong account.
Find out which one you are currently using in CLI:
gcloud config configurations list
gcloud auth list
If the selected configuration is wrong, fix it and then retry with gcloud compute firewall-rules create.
I found the solution.
As build artifact you need to publish, firebase.json, .firebaserc and whole functions folder including package.json (without node_modules)
Then in release using sudo firebase deploy --token $(firebase-token) --project $(firebase-project) --only functions --force
Firstly, docker-compose is is a tool for defining and running multi-container Docker applications. (https://docs.docker.com/compose/).
Dockerfile is single-container, if you want to run multi-containers on GKE you should convert docker-compose to kubernetes deployment.
You can manually convert or use http://kompose.io/ to convert automatically.
TombstonedTaskError is raised if you're attempting to enqueue a named task using a name that has been used recently, see What is TombstonedTaskError from App Engine's Task Queue?.
The duration of the de-duplication logic has been documented since that answer was posted. From Naming a task (emphasis mine):
When you create a new task, App Engine assigns ...
The easiest approach does appear to be to use gcloud, as trying to get a kubeconfig without it proved tricky.
Fortunately, gcloud, kubectl and helm are available as a single docker image kiwigrid/gcloud-kubectl-helm. For example:
docker run -it --rm --volume ./gcp-key-file.json:/data/gcp-key-file.json:ro kiwigrid/gcloud-kubectl-helm:2.11.0-224.0.0 bash