Questions tagged [amazon-web-services]
For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]
567
questions
0
votes
0
answers
12
views
Root cause for my problem when deploying Spacy on AWS lambda (Klayers)?
I have been following this guide https://towardsdatascience.com/quickstart-spacy-on-aws-lambda-up-and-running-in-10-minutes-e347037a0ef8 to get Spacy up and running on AWS lambda. I have followed the ...
- 101
0
votes
0
answers
30
views
How to deploy a Docker image from DockerHub to AWS Beanstalk using Gitlab CI/CD?
I am not very familiar with Gitlab CI/CD, Docker (Hub) and AWS but I am trying to deploy a Docker image from Docker Hub to an AWS Beanstalk environment (so basically as a new version to a running ...
- 1
1
vote
0
answers
11
views
AWS Cloudformation - managing multiple stages versioning and deployment
I'm working on a simple cloudformation stack for a web app (some lambda functions, api gateway, cloudfront distribution, etc).
The cloudformation stack template is currently versioned on a gitlab ...
- 111
0
votes
0
answers
11
views
Deploying a FE and Lambda on the same AWS CloudFront distribution
I have an S3 bucket thats deployed on a domain trough CloudFront and I also have a lambda function that should also get requests from the same domain as the FE and I have no idea how I can acheave ...
- 1
0
votes
0
answers
38
views
Why can't I get past the credentials page when running Grafana in ECS?
I have been playing for a while with Grafana, installed in Docker on my Mac. That's been working great. My company has a set of Terraform code that lets one easily host an arbitrary Docker image/...
- 103
0
votes
1
answer
23
views
Release rollback approaches?
I've got an old monolithic project using MariaDB and PHP that I'm trying to put on CI/CD. The project has DB migrations to update the DB state. My current CD is built on top of AWS CodeCommit + ...
- 103
-1
votes
0
answers
18
views
AWS WAF gets disassociated intermittently
any particular reason why an EC2 instance in an EKS cluster keeps disassociating the WAF (Web Access Firewall) from the Application Load Balancer?
0
votes
0
answers
23
views
subnet_arn for datasync location using Terraform vpc module?
In Terraform, I'm trying to define a datasync location for syncing files from S3 -> EFS. I'm new to Terraform and using the terraform-aws-modules/vpc/aws module[1] to help me get started so I ...
- 1
0
votes
0
answers
31
views
How can I view data exported from AWS RDS Performance Insights locally?
We use Performance Insights in RDS to discover and troubleshoot DB query issues. It is very useful to be able to look at a timeline with the dev team and point out the effect of badly formed queries ...
1
vote
0
answers
10
views
Connecting multiple VPCs [closed]
Good morning, I currently have four hosting providers:
AWS
Azure
Contabo
Housing
I would like to control access via a VPN, with certificate authentication.
How could I do to centralize everything in ...
- 11
0
votes
1
answer
31
views
How do you deploy a container to AWS Lambda?
I am working on this little project.
https://github.com/jamesgeddes/itsbeginningtolookalotlikechristmas
It's currently a work-in-progress - don't judge!
As you can see, I have configured CircleCI to ...
- 231
0
votes
0
answers
41
views
ALB causing an additional +150ms latency
I've set up an Application Load Balancer - ECS stack and noticed the ALB is causing latency issues. Direct requests to the Fargate instance have a latency of ~15ms consistently, but requests to the ...
0
votes
0
answers
33
views
Whats the most reliable away to connect a jenkins slave machine to AWS VPC
I currently have a mac mini thats connected to a corporate network.
This mac mini acts as a jenkins slave for our main jenkins instance.
The main jenkins instance is an EC2 instance on our AWS.
The ...
- 101
0
votes
0
answers
12
views
s3: reading parquet files with a subset of columns as argument; does this reduce data transfer?
I have set of large tables stored as parquets on s3.
In python, I'm using:
pd.read_parquet(...,columns=columns)
I'm reading the files directly from s3, without any database engine whatsoever for ...
0
votes
1
answer
33
views
How frequently is AWS Route 53 DNS Latency-Based Routing (LBR) recalculated for a given user?
Does anybody know how frequently one could expect Route 53's latency-based routing data to change for a given user?
For example, if I have Route 53 LBR setup with CloudFront sitting in front of 2 ...
- 101
0
votes
0
answers
89
views
Terraform & Helm & aws-load-balancer-controller : ALB won't be created
I try to deploy a complete cluster using EKS. When I run terraform apply the command completes successfully. I can see that my configured Pods, Deployments, Services were created. I also see the ...
- 101
0
votes
0
answers
17
views
simplest way to trigger my AWS cloudformation(cdk) if my github action finished(publish.yml)
long story short , I have a react js app that I build and upload to s3 with github actions. I tried with aws cloudbuild but it only offers me the default hooks which doesn't wait for my github action ...
- 101
0
votes
0
answers
10
views
How to configure shared VPC for kOps?
As described in this documentation, I want to create a Kubernetes cluster using kOps in an existing VPC. I have created a VPC, Internet Gateway, Route Table, Subnet and an EC2 instance which I want to ...
- 101
0
votes
0
answers
213
views
AWS EKS Kubernetes cluster unreachable: dial tcp Timeout
I configured EKS Cluster with Terraform, and used Helm to deploy ingress.
When I try to apply my Terraform configuration, it fails to create the ingress software because it fails to connect the EKS ...
- 101
0
votes
0
answers
6
views
What is the best approach to deploy N number of ML models as a scalable service in the Cloud?
I've N (~50) number of sentiment models of different languages, which were fine tuned on HggingFace's transformer models. Each of the models as 2-3 GB in size approx. Now, how can I deploy all these ...
0
votes
1
answer
53
views
How can I set a Route53 record as an alias for EKS load balancer?
I set an EKS cluster using Terraform. I try to set Route53 record to map my domain name, to the load balancer of my cluster.
I set my EKS cluster:
resource "aws_eks_cluster" "main" ...
- 101
1
vote
0
answers
116
views
What is IPC:BufferIO in managed postgresql metrics on AWS
I have a managed postgresql instance on AWS.
Sometimes the database session load seems excessive
in RDS > Databases > [instance] page
Then in the metrics I see the following graph:
My question ...
- 111
0
votes
1
answer
52
views
How to verify the time zone change is correct on AWS EC2 using Ansible?
We can use the following code to set a new timezone on AWS EC2 using Ansible.
---
- hosts: linuxservers proxmoxservers
remote_user: ansible
become: yes
tasks:
- name: 'Set timezone to Buenos ...
- 235
1
vote
1
answer
115
views
I cannot exec into a docker container running in ECS
I'm attempting to login to a container (from ECR) deployed into an AWS ECS cluster. For what it's worth I'm using the docker compose/ecs integration to deploy this cluster. My docker compose file is ...
- 11
0
votes
1
answer
310
views
Does AWS CloudFront work with a Network Load Balancer?
I am aware that it is straightforward to use AWS CloudFront with an AWS Application Load Balancer (Layer 7) origin (using a certificate in each for E2E encryption). However, is it possible to use AWS ...
- 11
0
votes
0
answers
32
views
Automating AWS Cloud resources provisioning for laravel multi-tenant app
I have a Laravel web application, that is a school management system.
Currently I am using Heroku to host the application, but I now want migrate to AWS for cloud hosting.
I want to be able to create ...
- 1
0
votes
0
answers
9
views
Does DMS reset the inserts/deletes/updates in a migration task every few days?
I have a AWS DMS task which migrates SQL Server to Cloud data warehouse. I checked the task after a few days and saw the number of rows in source and target databases have increased but the inserts/...
3
votes
1
answer
98
views
What is the best way to install ArgoCD as code?
Working on getting a full deployment pipeline set up using GitOps and Everything as Code. I, therefore, need to be able to spin everything up and down with a single click (or pretty close to it!). My ...
- 231
0
votes
1
answer
133
views
Jenkins configure cloud not working with Amazon EC2 Credentials
I am new to AWS and Jenkins. I am trying to connect an ec2 instance that has Jenkins installed to the AWS cloud plugin but for some reason, I am unsure why i am getting the following issue '
Failed ...
- 101
0
votes
0
answers
36
views
CICD AWS Secrets Manager - How to determine which secrets to inject?
I am working on implementing "secrets injection" on a GitLab CI pipeline. The secrets are stored on AWS Secrets Manager.
The goal is to create a appsettings.json file containing the secrets ...
- 171
1
vote
1
answer
72
views
Error: a number is required
I'm in the process of upgrading our version of the Terraform AWS Provider and after fixing/updating every resource and data source which has been deprecated/changed between versions (3.75.2 -> 4.0....
- 131
0
votes
0
answers
15
views
What is the difference between m6g.16xlarge and m6g.metal AWS EC2 intance type?
I heard there was new instance type available from AWS EC2 M6 graviton. Planning to use them but my question was what is difference between
m6g.16xlarge and m6g.metal
as both has same performance ...
- 287
0
votes
1
answer
185
views
aws_availability_zones returns an availability zone ap-southeast-2c that is not available
I'm attempting to create an AWS RDS Serverless v2 cluster in region ap-southeast-2 (Sydney) using the following Terraform configuration:
provider "aws" {
region = "ap-southeast-2"...
- 101
0
votes
0
answers
50
views
is it possible to read dns ip address from resolv.conf with in aws ecs container and use at the server startup?
app architecture:
[
The normal request flow happens when an api request triggered from the UI as shown in the above diagram(abstracted few components to talk about specific point) as shown in the ...
1
vote
0
answers
26
views
Get Byte Size of Individual Log in Log Insights
I am looking at a given LogGroup within the Log Insights.
I can filter the logs by a field.
e.g.
fields @message
| sort @timestamp desc
| filter time < 3
How can I find out how much much data ...
- 11
0
votes
1
answer
38
views
Unable to login as `ubuntu` user on ec2 instance spawned from auto scaling group
Utilizing Ansible AWS modules, I'm creating an AMI from an existing EC2 instance where I am able to ssh with both my user and default account (ubuntu). After the AMI is in a ready state, I then create ...
- 1
0
votes
0
answers
17
views
Issues leveraging AWS Policy to AssumeRole with Conditional that the SessionName Contains the Username
I was following an AWS blog post that outlines a neat trick to enforce an AssumeRole session name includes the assumer's username. The same technique is referenced in other third party blog posts as ...
- 101
0
votes
1
answer
276
views
IAM Permissions issue in API Gateway Deployment
AWS threw a below error saying the user doesn't have access to apigateway:TagResource permission, but when I checklist of available permissions in the IAM console, I'm not able to find any such ...
- 103
2
votes
0
answers
21
views
What happens if I upload a new version of an object already transitioned to Glacier
I created a bucket with versioning enabled and put 500GB of objects there.
I also set a lifecycle policy that transitions the whole bucket to S3 Glacier after 30 days and it was already executed.
Let'...
- 21
0
votes
0
answers
74
views
How to pass correctly credentials via api token to helm chart?
I'm trying to pass credentials to Helm Chart ---> https://artifacthub.io/packages/helm/bitnami/mysql
I use Secret Store CSI Driver and Driver from AWS. Credentials are passed without any problems ...
1
vote
0
answers
97
views
Cluster Autoscaler Crash: Unable to build proper template node
My Cluster Autoscaler (CAS) Pod V.1.17 stops working when it restarts and a Autoscaling Group (ASG) is scaled to 0. CAS enters a loop with the following message:
utils.go:126] Unable to build proper ...
- 111
0
votes
0
answers
28
views
AWS S3 Versioning Life Cycle Policies
I'm attempting to create a LifeCycle policy in my Versioning enabled S3 bucket that will auto-delete delete markers produced when Users manually delete an object.
User removes object (either through ...
0
votes
0
answers
98
views
Database Project Deploy to AWS RDS Endpoint
Solving: Successfully run a "Publish Database Project" (dacpac) task against an AWS RDS instance endpoint vis Azure DevOps.
Problem: The task uses SqlPackage.exe to handle the dacpac file ...
- 101
0
votes
0
answers
28
views
Proper separation of IaC and code deployment via CI / CD
We're about to implement infrastructure-as-code on our project. We already have CI/CD pipelines that deploy:
A CloudFormation stack for an ECS service
Several CloudFormation stacks for AWS lamdbas (...
- 101
0
votes
1
answer
212
views
calculating the size of objects in AWS S3 buckets
I ran into an problem recently, my AWS S3 bucket shows total size of 30 TB. However when i try to get the total size of individual folders, it is not summing up more than 2 TB.
I used the below ...
- 3
0
votes
2
answers
175
views
Why is my AWS Application Load Balancer not exposing my Kubernetes service?
I am following a tutorial to set Kubernetes with an ingress managed service. The cluster is,
1 controller
2 worker Kubernetes cluster
kubeadm built
running Kubernetes v1.25.3 (latest at the time of ...
0
votes
0
answers
22
views
how to authenticate with the openvpn which has microsoft authenticator time based OTP authenticatiopipeline?
I have a cluster in the AWS EKS. We are using OpenVPN to connect to the cluster namespace and to connect to OpenVPN, we enabled the Microsoft MFA authenticator (Time-based OTP).
The GitHub action ...
0
votes
0
answers
124
views
Using bash arrays in AWS CodeBuild buildspec commands
Given the buildspec:
version: 0.2
env:
shell: bash
phases:
build:
commands:
- STR_OUTPUT=str && echo "STR_OUTPUT IS $STR_OUTPUT"
- echo "STR_OUTPUT IS $...
- 1
0
votes
0
answers
40
views
Is it possible to control the speed of an AWS Eventbridge event replay?
We save all events from our application event bus into an archive. Sometimes we replay events from the archive to backfill data for a new service (we target the rule for that service).
We've found ...
- 101
1
vote
0
answers
17
views
Does kops 1.22+ allow to assign a custom IAM role to a kubernetes node?
I'm using kops 1.22.6 to add a new node to my k8s cluster
(working with AWS).
The new node should optimally use the custom IAM role, unlike the generic IAM roles that kops created for the rest of the ...
