Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

Filter by
Sorted by
Tagged with
0 votes
0 answers
12 views

Root cause for my problem when deploying Spacy on AWS lambda (Klayers)?

I have been following this guide https://towardsdatascience.com/quickstart-spacy-on-aws-lambda-up-and-running-in-10-minutes-e347037a0ef8 to get Spacy up and running on AWS lambda. I have followed the ...
0 votes
0 answers
30 views

How to deploy a Docker image from DockerHub to AWS Beanstalk using Gitlab CI/CD?

I am not very familiar with Gitlab CI/CD, Docker (Hub) and AWS but I am trying to deploy a Docker image from Docker Hub to an AWS Beanstalk environment (so basically as a new version to a running ...
1 vote
0 answers
11 views

AWS Cloudformation - managing multiple stages versioning and deployment

I'm working on a simple cloudformation stack for a web app (some lambda functions, api gateway, cloudfront distribution, etc). The cloudformation stack template is currently versioned on a gitlab ...
  • 111
0 votes
0 answers
11 views

Deploying a FE and Lambda on the same AWS CloudFront distribution

I have an S3 bucket thats deployed on a domain trough CloudFront and I also have a lambda function that should also get requests from the same domain as the FE and I have no idea how I can acheave ...
0 votes
0 answers
38 views

Why can't I get past the credentials page when running Grafana in ECS?

I have been playing for a while with Grafana, installed in Docker on my Mac. That's been working great. My company has a set of Terraform code that lets one easily host an arbitrary Docker image/...
0 votes
1 answer
23 views

Release rollback approaches?

I've got an old monolithic project using MariaDB and PHP that I'm trying to put on CI/CD. The project has DB migrations to update the DB state. My current CD is built on top of AWS CodeCommit + ...
  • 103
-1 votes
0 answers
18 views

AWS WAF gets disassociated intermittently

any particular reason why an EC2 instance in an EKS cluster keeps disassociating the WAF (Web Access Firewall) from the Application Load Balancer?
0 votes
0 answers
23 views

subnet_arn for datasync location using Terraform vpc module?

In Terraform, I'm trying to define a datasync location for syncing files from S3 -> EFS. I'm new to Terraform and using the terraform-aws-modules/vpc/aws module[1] to help me get started so I ...
0 votes
0 answers
31 views

How can I view data exported from AWS RDS Performance Insights locally?

We use Performance Insights in RDS to discover and troubleshoot DB query issues. It is very useful to be able to look at a timeline with the dev team and point out the effect of badly formed queries ...
1 vote
0 answers
10 views

Connecting multiple VPCs [closed]

Good morning, I currently have four hosting providers: AWS Azure Contabo Housing I would like to control access via a VPN, with certificate authentication. How could I do to centralize everything in ...
0 votes
1 answer
31 views

How do you deploy a container to AWS Lambda?

I am working on this little project. https://github.com/jamesgeddes/itsbeginningtolookalotlikechristmas It's currently a work-in-progress - don't judge! As you can see, I have configured CircleCI to ...
0 votes
0 answers
41 views

ALB causing an additional +150ms latency

I've set up an Application Load Balancer - ECS stack and noticed the ALB is causing latency issues. Direct requests to the Fargate instance have a latency of ~15ms consistently, but requests to the ...
0 votes
0 answers
33 views

Whats the most reliable away to connect a jenkins slave machine to AWS VPC

I currently have a mac mini thats connected to a corporate network. This mac mini acts as a jenkins slave for our main jenkins instance. The main jenkins instance is an EC2 instance on our AWS. The ...
  • 101
0 votes
0 answers
12 views

s3: reading parquet files with a subset of columns as argument; does this reduce data transfer?

I have set of large tables stored as parquets on s3. In python, I'm using: pd.read_parquet(...,columns=columns) I'm reading the files directly from s3, without any database engine whatsoever for ...
0 votes
1 answer
33 views

How frequently is AWS Route 53 DNS Latency-Based Routing (LBR) recalculated for a given user?

Does anybody know how frequently one could expect Route 53's latency-based routing data to change for a given user? For example, if I have Route 53 LBR setup with CloudFront sitting in front of 2 ...
0 votes
0 answers
89 views

Terraform & Helm & aws-load-balancer-controller : ALB won't be created

I try to deploy a complete cluster using EKS. When I run terraform apply the command completes successfully. I can see that my configured Pods, Deployments, Services were created. I also see the ...
  • 101
0 votes
0 answers
17 views

simplest way to trigger my AWS cloudformation(cdk) if my github action finished(publish.yml)

long story short , I have a react js app that I build and upload to s3 with github actions. I tried with aws cloudbuild but it only offers me the default hooks which doesn't wait for my github action ...
  • 101
0 votes
0 answers
10 views

How to configure shared VPC for kOps?

As described in this documentation, I want to create a Kubernetes cluster using kOps in an existing VPC. I have created a VPC, Internet Gateway, Route Table, Subnet and an EC2 instance which I want to ...
0 votes
0 answers
213 views

AWS EKS Kubernetes cluster unreachable: dial tcp Timeout

I configured EKS Cluster with Terraform, and used Helm to deploy ingress. When I try to apply my Terraform configuration, it fails to create the ingress software because it fails to connect the EKS ...
  • 101
0 votes
0 answers
6 views

What is the best approach to deploy N number of ML models as a scalable service in the Cloud?

I've N (~50) number of sentiment models of different languages, which were fine tuned on HggingFace's transformer models. Each of the models as 2-3 GB in size approx. Now, how can I deploy all these ...
0 votes
1 answer
53 views

How can I set a Route53 record as an alias for EKS load balancer?

I set an EKS cluster using Terraform. I try to set Route53 record to map my domain name, to the load balancer of my cluster. I set my EKS cluster: resource "aws_eks_cluster" "main" ...
  • 101
1 vote
0 answers
116 views

What is IPC:BufferIO in managed postgresql metrics on AWS

I have a managed postgresql instance on AWS. Sometimes the database session load seems excessive in RDS > Databases > [instance] page Then in the metrics I see the following graph: My question ...
  • 111
0 votes
1 answer
52 views

How to verify the time zone change is correct on AWS EC2 using Ansible?

We can use the following code to set a new timezone on AWS EC2 using Ansible. --- - hosts: linuxservers proxmoxservers remote_user: ansible become: yes tasks: - name: 'Set timezone to Buenos ...
  • 235
1 vote
1 answer
115 views

I cannot exec into a docker container running in ECS

I'm attempting to login to a container (from ECR) deployed into an AWS ECS cluster. For what it's worth I'm using the docker compose/ecs integration to deploy this cluster. My docker compose file is ...
0 votes
1 answer
310 views

Does AWS CloudFront work with a Network Load Balancer?

I am aware that it is straightforward to use AWS CloudFront with an AWS Application Load Balancer (Layer 7) origin (using a certificate in each for E2E encryption). However, is it possible to use AWS ...
  • 11
0 votes
0 answers
32 views

Automating AWS Cloud resources provisioning for laravel multi-tenant app

I have a Laravel web application, that is a school management system. Currently I am using Heroku to host the application, but I now want migrate to AWS for cloud hosting. I want to be able to create ...
  • 1
0 votes
0 answers
9 views

Does DMS reset the inserts/deletes/updates in a migration task every few days?

I have a AWS DMS task which migrates SQL Server to Cloud data warehouse. I checked the task after a few days and saw the number of rows in source and target databases have increased but the inserts/...
3 votes
1 answer
98 views

What is the best way to install ArgoCD as code?

Working on getting a full deployment pipeline set up using GitOps and Everything as Code. I, therefore, need to be able to spin everything up and down with a single click (or pretty close to it!). My ...
0 votes
1 answer
133 views

Jenkins configure cloud not working with Amazon EC2 Credentials

I am new to AWS and Jenkins. I am trying to connect an ec2 instance that has Jenkins installed to the AWS cloud plugin but for some reason, I am unsure why i am getting the following issue ' Failed ...
0 votes
0 answers
36 views

CICD AWS Secrets Manager - How to determine which secrets to inject?

I am working on implementing "secrets injection" on a GitLab CI pipeline. The secrets are stored on AWS Secrets Manager. The goal is to create a appsettings.json file containing the secrets ...
  • 171
1 vote
1 answer
72 views

Error: a number is required

I'm in the process of upgrading our version of the Terraform AWS Provider and after fixing/updating every resource and data source which has been deprecated/changed between versions (3.75.2 -> 4.0....
0 votes
0 answers
15 views

What is the difference between m6g.16xlarge and m6g.metal AWS EC2 intance type?

I heard there was new instance type available from AWS EC2 M6 graviton. Planning to use them but my question was what is difference between m6g.16xlarge and m6g.metal as both has same performance ...
  • 287
0 votes
1 answer
185 views

aws_availability_zones returns an availability zone ap-southeast-2c that is not available

I'm attempting to create an AWS RDS Serverless v2 cluster in region ap-southeast-2 (Sydney) using the following Terraform configuration: provider "aws" { region = "ap-southeast-2"...
0 votes
0 answers
50 views

is it possible to read dns ip address from resolv.conf with in aws ecs container and use at the server startup?

app architecture: [ The normal request flow happens when an api request triggered from the UI as shown in the above diagram(abstracted few components to talk about specific point) as shown in the ...
1 vote
0 answers
26 views

Get Byte Size of Individual Log in Log Insights

I am looking at a given LogGroup within the Log Insights. I can filter the logs by a field. e.g. fields @message | sort @timestamp desc | filter time < 3 How can I find out how much much data ...
0 votes
1 answer
38 views

Unable to login as `ubuntu` user on ec2 instance spawned from auto scaling group

Utilizing Ansible AWS modules, I'm creating an AMI from an existing EC2 instance where I am able to ssh with both my user and default account (ubuntu). After the AMI is in a ready state, I then create ...
  • 1
0 votes
0 answers
17 views

Issues leveraging AWS Policy to AssumeRole with Conditional that the SessionName Contains the Username

I was following an AWS blog post that outlines a neat trick to enforce an AssumeRole session name includes the assumer's username. The same technique is referenced in other third party blog posts as ...
  • 101
0 votes
1 answer
276 views

IAM Permissions issue in API Gateway Deployment

AWS threw a below error saying the user doesn't have access to apigateway:TagResource permission, but when I checklist of available permissions in the IAM console, I'm not able to find any such ...
2 votes
0 answers
21 views

What happens if I upload a new version of an object already transitioned to Glacier

I created a bucket with versioning enabled and put 500GB of objects there. I also set a lifecycle policy that transitions the whole bucket to S3 Glacier after 30 days and it was already executed. Let'...
0 votes
0 answers
74 views

How to pass correctly credentials via api token to helm chart?

I'm trying to pass credentials to Helm Chart ---> https://artifacthub.io/packages/helm/bitnami/mysql I use Secret Store CSI Driver and Driver from AWS. Credentials are passed without any problems ...
1 vote
0 answers
97 views

Cluster Autoscaler Crash: Unable to build proper template node

My Cluster Autoscaler (CAS) Pod V.1.17 stops working when it restarts and a Autoscaling Group (ASG) is scaled to 0. CAS enters a loop with the following message: utils.go:126] Unable to build proper ...
0 votes
0 answers
28 views

AWS S3 Versioning Life Cycle Policies

I'm attempting to create a LifeCycle policy in my Versioning enabled S3 bucket that will auto-delete delete markers produced when Users manually delete an object. User removes object (either through ...
0 votes
0 answers
98 views

Database Project Deploy to AWS RDS Endpoint

Solving: Successfully run a "Publish Database Project" (dacpac) task against an AWS RDS instance endpoint vis Azure DevOps. Problem: The task uses SqlPackage.exe to handle the dacpac file ...
  • 101
0 votes
0 answers
28 views

Proper separation of IaC and code deployment via CI / CD

We're about to implement infrastructure-as-code on our project. We already have CI/CD pipelines that deploy: A CloudFormation stack for an ECS service Several CloudFormation stacks for AWS lamdbas (...
  • 101
0 votes
1 answer
212 views

calculating the size of objects in AWS S3 buckets

I ran into an problem recently, my AWS S3 bucket shows total size of 30 TB. However when i try to get the total size of individual folders, it is not summing up more than 2 TB. I used the below ...
  • 3
0 votes
2 answers
175 views

Why is my AWS Application Load Balancer not exposing my Kubernetes service?

I am following a tutorial to set Kubernetes with an ingress managed service. The cluster is, 1 controller 2 worker Kubernetes cluster kubeadm built running Kubernetes v1.25.3 (latest at the time of ...
0 votes
0 answers
22 views

how to authenticate with the openvpn which has microsoft authenticator time based OTP authenticatiopipeline?

I have a cluster in the AWS EKS. We are using OpenVPN to connect to the cluster namespace and to connect to OpenVPN, we enabled the Microsoft MFA authenticator (Time-based OTP). The GitHub action ...
0 votes
0 answers
124 views

Using bash arrays in AWS CodeBuild buildspec commands

Given the buildspec: version: 0.2 env: shell: bash phases: build: commands: - STR_OUTPUT=str && echo "STR_OUTPUT IS $STR_OUTPUT" - echo "STR_OUTPUT IS $...
0 votes
0 answers
40 views

Is it possible to control the speed of an AWS Eventbridge event replay?

We save all events from our application event bus into an archive. Sometimes we replay events from the archive to backfill data for a new service (we target the rule for that service). We've found ...
  • 101
1 vote
0 answers
17 views

Does kops 1.22+ allow to assign a custom IAM role to a kubernetes node?

I'm using kops 1.22.6 to add a new node to my k8s cluster (working with AWS). The new node should optimally use the custom IAM role, unlike the generic IAM roles that kops created for the rest of the ...

1
2 3 4 5
12