Questions tagged [gcp]
For questions about Google Cloud Platform products and services.
46
questions
0
votes
1
answer
35
views
What's the penalty for dropping a Google Cloud commitment?
Google Cloud is offering me discounts if I commit to a service for three years. I'm having a hard time trying to find out what's the penalty should I leave early.
The discount is tempting, but I'm ...
- 61
0
votes
0
answers
33
views
how to detect immutable field changes with helm before upgrade
We have pipelines to do some deployments in GCP. Underneath our pipeline uses helm apply/upgrade and sometimes it fails when our users try to change immutable helm fields. For example ...
- 1
0
votes
0
answers
7
views
How to do client on-prem deployment of machine learning models without exposing the code files and model?
I am working on a project that involves the deployment of my code and ML model files to be deployed on a client virtual machine.
Since this is a proprietary code and model, is there a way to deploy ...
- 1
0
votes
0
answers
9
views
Loadbalancer for the GCP Private Service Connect Endpoints
I have two Private Service Connect Endpoints to connect to a published service in two different regions. I am trying to find if it is possible to have a load balancer on my end to load balance between ...
- 131
0
votes
0
answers
30
views
Error creating GCP notebook: Error waiting for Creating Instance: Error code 12, message: GCE unexpected error: RPC::UNREACHABLE: EOF
I'm trying to create a managed notebook for Google Cloud Vertex AI, and the application of the terraform template fails with:
Plan: 1 to add, 0 to change, 0 to destroy.
google_notebooks_instance....
- 138
1
vote
1
answer
37
views
ansible_become has no effect despite the ability to execute sudo on GCP hosts
Say I want to execute the following command on target hosts (deployed on GCP): ansible all -a "head -1 /etc/shadow".
The command demands the root access. With the default Ansible ...
- 111
0
votes
0
answers
7
views
From Docker container CPU stat to Kubernetes pod CPU requirement
Say I have 3 containers in a 8 CPU host in GCP and they have had the following CPU% mean usage for the last week:
CONTAINER
CPU %
app1
500%
app2
100%
app3
50%
Now I want to migrate to Kubernetes. ...
0
votes
0
answers
50
views
Unable to connect to FTP server using custom VPC in Google Cloud Function
I am trying to connect to an FTP server using a Google Cloud Function. My Cloud Function uses a VPC Connector to access resources in my VPC network. The Cloud Function successfully connects to the FTP ...
- 101
1
vote
0
answers
40
views
How can I point Cloud Run to my latest container image when its path changes based on version?
I am trying to model continuous deployment infrastructure in Terraform.
The problem I have is Cloud Run requires a path to the container image, and that image's path changes based on its 'version'.
...
- 111
0
votes
0
answers
20
views
How do I provide my app with a service account key to access a GCP bucket?
I'm experimenting with terraform and GCP at the moment. For now I want to run a ruby project locally that have access to a bucket. For that I supposedly need a service account and a key. terraform ...
- 143
0
votes
0
answers
19
views
GKE attaches huge volume when starting a redis cluster from redis:5.0.1-alpine
We are aiming towards creating a Redis cluster in our GKE cluster.
For that cause, we followed the tutorial and code sample on collabnix (very straightforward, and very simple, kudos to the author! )
...
- 195
0
votes
0
answers
13
views
How to really handle users using Cloud Functions and NOT Firebase?
Creating and authenticating new users using Firebase is a breeze, the API is so simple.
When you create a Cloud Function directly with Google Cloud Platform, you would like to allow new users to join ...
0
votes
0
answers
53
views
GCP Storage transfer service: Unable to connect transfer agents to pool
I wanted to make use of GCP Cloud Transfer Service to sync data from on-premise. For this I had to install agents and connect them to a pool. I was following the steps here, where they provide gcloud/...
0
votes
0
answers
38
views
Kubernetes surge evicted pods like rolled out pods
Is there a way to reproduce the rolling update strategy's maxSurge of a deployment i.e
strategy:
rollingUpdate:
maxSurge: 1
maxUnavailable: 0
type: RollingUpdate
While using a ...
- 115
0
votes
0
answers
6
views
What is the best approach to deploy N number of ML models as a scalable service in the Cloud?
I've N (~50) number of sentiment models of different languages, which were fine tuned on HggingFace's transformer models. Each of the models as 2-3 GB in size approx. Now, how can I deploy all these ...
2
votes
1
answer
39
views
GCP log based availability metric
we have a GKE hosted API served by Go/Gin service. It logs every request with some structured metadata (including status_code). We'd like to create an availability SLI (which is defined as a ...
- 123
0
votes
0
answers
13
views
End to end testing - Data Pipelines built using GCP Services
I have a data pipeline that has been built using GCP services. Obviously, I have GCP Account. In those pipelines, I use various GCP Services like: PUb-Sub, Cloud functions, cloud compute, Dataflow, ...
4
votes
1
answer
186
views
Is there aws-vault kind of tool for GCP?
I would like to keep my use access tokens to GCP encrypted in my operating system’s keychain and use them easily with gcloud CLI.
So, does aws-vault for gcp exist to secure my own tokesn when ...
- 141
0
votes
1
answer
361
views
Argo workflows health checks failing in GKE
I am trying to expose my argo workflows deployment to a domain but I keep getting Server Error when I access the domain: argo.example.com. I setup a GKE ingress and been trying to fix the health ...
- 121
0
votes
1
answer
108
views
Why is my GCP managed Cert not working with kubernetes
I have the following that seems to work...
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
name: test-ingress
namespace: test
annotations:
kubernetes.io/ingress.global-static-ip-...
- 141
1
vote
1
answer
555
views
how to schedule container in GCP
I have 5 tasks in my project that need to be run periodically. Some of these tasks are run on a daily basis, some on a weekly basis.
I try to containerize each task in a Docker image. Here is one ...
- 11
2
votes
1
answer
60
views
How do I setup a script to run on a schedule in a clean & professional way?
I have a small python piece of code that I want to run on a schedule. The dirty way to do it would be to just spin up an EC2 instance and use CRON to run the script.
But I was wondering if there's a ...
- 123
1
vote
1
answer
28
views
Accelerate autoscaled VM boot time
We're using Google Cloud Platform with an autoscaled pool of VM behind a google's load-balancer.
When a new VM is created in the pool it starts from a template then executes a startup-script. The ...
- 11
1
vote
1
answer
233
views
How to filter all roles with specific user in GCP
gcloud projects get-iam-policy [PROJECT-ID] lists all users with their roles for specific project.
There are different filters and formatters available but I can't seem to find the right way to just ...
- 125
0
votes
1
answer
301
views
Predictive autoscaling on K8s
I am learning about using Machine Learning for provisioning proactive resources on the Kubernetes and I have found some of the interesting articles about it on the internet(for instance for Thoth or ...
- 101
1
vote
3
answers
632
views
Can we do zero-downtime kubernetes deployment with a single pod?
I've inherited an app with K8s services with the following config
spec:
...
replicas: 1
strategy:
rollingUpdate:
maxSurge: 1
maxUnavailable: 1
type: RollingUpdate
For most ...
- 111
7
votes
2
answers
7k
views
How to list all users with specific role in GCP
gcloud projects get-iam-policy [PROJECT-ID] lists all users with their roles for specific project. There are different filters and formatters available but I can't seem to find the right way to just ...
- 173
1
vote
1
answer
147
views
Is Google Kubernetes (GKE) worth it for a program that runs once a week?
My team is on the process of migrating all our cloud applications from AWS to GCP, and we were considering using GKE for our main program, until we got the news that Google will now charge an hourly ...
2
votes
1
answer
298
views
SFTP server with third party user management system?
I understand how to set up SFTP servers on Linux and create users and their passwords manually.
So basically, the users get authenticated as normal Linux users get authenticated through /etc/passwd. ...
- 153
2
votes
1
answer
120
views
How to connect GCP Load balancer to Kubernetes cluster(single node cluster)
I'm creating a single node(name: node1) k8 cluster for demos. I have setup a nginx-ingress controller.
service/volted-marmot-nginx-ingress-controller LoadBalancer 10.100.132.29 <pending&...
- 195
0
votes
2
answers
1k
views
How deploy public key to newly created VM on GCP?
I create VM instance using ansible module gcp_compute_instance
My code:
---
- name: Create jenkins node-1
hosts: localhost
connection: local
gather_facts: no
vars:
address: <my ip>
...
- 47
2
votes
1
answer
1k
views
GCP - Can't create a tpu on europe-west1
I'my trying to create a tpu for my vm instance from this tutorial but get this error message:
ERROR: (gcloud.compute.tpus.create) PERMISSION_DENIED: Location europe-west1-b is not found or access is ...
- 75
1
vote
1
answer
35
views
GCP compute quota hard caps?
Are there published upper limits or hard caps for the GCE CPU or Managed Instance Group Quota per account? I know that you can request to increase your Quota, but I have not been able to find what the ...
user17155
1
vote
1
answer
203
views
Compound calculation of GCP GCE SLAs based on number of instances?
GCP publishes a 99.99% uptime SLA for GCE.
How would I calculate an estimated SLA if my application used services deployed on 1,000 GCE instances? Assuming that the services were dependent on each ...
user17155
14
votes
2
answers
22k
views
Kubernetes - How to show all service accounts
How do I show all service accounts In Kubernetes?
I have tried kubectl get --all-namespaces all. It does not show service accounts.
How can I use kubectl to list all service accounts?
- 1,413
4
votes
1
answer
411
views
Building a CI/CD pipeline on GCP
I have a containerized web application on GitHub and I would like to build a CI/CD pipeline on GCP consisting of a trigger stage, a build stage and a deployment stage and be able to do continuous ...
4
votes
1
answer
2k
views
How to download a VM image from GCP?
I do not see a download button. I would like to download a VM image that was created on GCP using Packer and I would like to run it locally in Virtualbox.
- 13.1k
3
votes
2
answers
104
views
What artifact managers are available in GCP?
I use Artifactory and Nexus3, but I wonder what artifact manager could be used in GCP? Is there a managed artifact manager or do I have to run one myself in a VM?
- 13.1k
3
votes
1
answer
1k
views
Google Cloud Registry and multiple projects
Is it possible to pull images from the same GCR from multiple GCP projects without making the registry public?
I want to do this so I do not have to upload multiple times the same image to multiple ...
- 183
2
votes
1
answer
3k
views
Installing Helm charts using Terraform
I have been trying to install Helm charts using Terraform in a cluster which operates in GKE.
My question is in two parts:
Is it a good practice to use Terraform for installing Helm charts?
I have ...
- 136
1
vote
1
answer
48
views
If we are using Kubernetes do we need to implement HA on both the infrastructure and application level?
Is this something that's going to be covered at the application level with pod autoscaling? Or should we implement both horizontal pod autoscaling and infrastructure high availability within our cloud ...
- 177
2
votes
1
answer
432
views
How to exclude storage.bucket.list permission on public gcp storage bucket
Google Cloud Platform Storage Buckets can be directly exposed via HTTP. The recommended configuration for this is to have allUsers with the Storage Object Viewer role.
The Storage Object Viewer role ...
- 123
10
votes
3
answers
4k
views
How should GCP projects be organized? [closed]
I have recently inherited the previous director of devops duties in managing a transition from Heroku/AWS to GCP. I'm wondering what is best practice for organizing projects in GCP.
Should the be ...
- 203
7
votes
2
answers
4k
views
How to know which user created the GCE Instance
We have several billing enabled projects in our GCP account and each of them has several Compute Engine Instances. I want to remove non-critical instances just to reduce the unnecessary billing. But ...
- 181
2
votes
2
answers
974
views
How to allow users to list authorized buckets in GCP Storage?
I created a storage bucket B and I granted a user as "Storage Object Viewer" on it.
The user can view bucket content with a direct link (e.g. https://console.cloud.google.com/storage/browser/B/?...
- 123
4
votes
1
answer
101
views
How to recreate GCP Preemptible VMs behind LB before they expire?
I created preemptible instances in a managed instance group behind LB, I specified the preemptible option in the instance template.
Because GCP Compute Engine always terminates preemptible instances ...
- 780