Questions tagged [google-cloud-storage]
For questions about Google's Cloud Storage (GCS) - a unified object storage product, part of the Google Cloud Platform offering.
10
questions
0
votes
1
answer
19
views
When OnPrem with Kubernetes, what is the recommended way to do file storage buckets?
When you are running kubernetes on GKS, AKS, etc, you use your cloud provider specific storage bucket such as Amazon S3, google cloud storage, azure blob storage, to store your raw binary content in a ...
0
votes
1
answer
92
views
Google Kubernetes Engine's auto-pilot mode does not grant nodes Google Storage write access
I am trying to use the workflow orchestrator Snakemake with a Google Kubernetes Engine (GKE) autopilot cluster. My workflow needs to upload files to Google Cloud Storage buckets within the same ...
- 101
0
votes
1
answer
143
views
How to set metadata of a blob from inside a Python Google Cloud Function? Test fails with "blob.size = 99 AttributeError: can't set attribute"
I try to add the rowcount to the metadata of the Google Cloud Storage file from inside the Python Google Cloud Function.
I follow the official Cloud Storage Docs example of "Edit object metadata&...
0
votes
1
answer
277
views
"Retrieve a blob, and its metadata": Does the get_blob() already cause file size dependent traffic on the Google Cloud Platform?
Quote from the Python code example at View and edit object metadata --> "Code Samples" --> "Python": Retrieve a blob, and its metadata.
The full code:
from google.cloud ...
1
vote
1
answer
68
views
Secure way of uploading data to Google Cloud Storage
We're making some machines in which there's a part which uploads the images captured by the camera to Google Cloud Storage. For this purpose what I've done is
Create a service account for each ...
- 11
1
vote
1
answer
20
views
GKE: Sharing the same filesystem across pods
I'm quite new and try to get my head around kubernetes and GKE so here it goes:
I would like an application to write data to a persistent storage.
If I'd scale up, or down, or a pod dies,
I'd like ...
- 121
1
vote
1
answer
40
views
How to make different permissions for different subdirectories of storage bucket
On Google Cloud Storage or Amazon S3, is there a way to give users a key to only a specific subdirectory of a storage bucket, for example:
gs://images.eng.cm.com/avatars/<user-uuid>/xyz
so the ...
- 365
2
votes
2
answers
909
views
How to allow users to list authorized buckets in GCP Storage?
I created a storage bucket B and I granted a user as "Storage Object Viewer" on it.
The user can view bucket content with a direct link (e.g. https://console.cloud.google.com/storage/browser/B/?...
- 123
5
votes
2
answers
767
views
Google Cloud Storage vs Redis / ElasticSearch
We're building an application that reads data from an API and displays it in a frontend. Due to API limits, we have to cache the API calls meaning that we save the result of the API calls (both user ...
- 161
13
votes
2
answers
3k
views
Can you use `aws-sdk` to store objects in Google Storage?
Google Storage claims they support interoperability in their solution with Amazon AWS S3 and Eucalyptus Systems APIs.
source: https://cloud.google.com/storage/docs/interoperability
Can the aws-sdk ...
- 8,707