Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

Filter by
Sorted by
Tagged with
0
votes
0answers
13 views

Terraform cannot destroy with EBS volume attached

to detach from Instance (): unexpected state 'busy', wanted target 'detached'. last error: %!s(<nil>) I get the above error when I try to run terraform destroy. I think the ebs volume must be ...
1
vote
0answers
9 views

Launching VM instances only when needed

I am looking for the right tool to launch VM instances on a cloud platform only when I need them. Once launched, they should run a containerized script (let's call it a job) that runs for about 5 to ...
0
votes
0answers
17 views

Gitlab (self hosted gitlab) pipeline fail when trying to fetch repository

I've setup own gitlab server on AWS EC2 Instance based on this image - https://aws.amazon.com/marketplace/pp/prodview-w6ykryurkesjq?ref_=aws-mp-console-subscription-detail and assign Elastic IP for ...
-1
votes
1answer
34 views

How many nodes can I have in single EKS cluster?

I have an EKS cluster and today my subnet had 0 Available IPv4 addresses. Does that mean that there are limits per nodes within 1 cluster in EKS?
0
votes
0answers
17 views
+100

Can an autoscaling group use both target tracking and scheduled policies?

I have an ECS cluster I'm deploying Docker images to using Fargate as the runtime. The containers run a process that consumes from a message broker queue. We'd like to define an autoscaling group that ...
0
votes
0answers
15 views

Connect Docker Swarm to AWS Application Load Balancer

What is the best practice to connect a Docker Swarm that is deployed in EC2 with an Application Load Balancer? In my configuration the ALB is what Route53 resolves to. The Docker Swarm is configured ...
2
votes
1answer
17 views

Do GitLab Runner worker nodes need to have network access to GitLab?

GitLab runner has an autoscale feature that allows the Runner Manager to dynamically spawn new worker nodes on demand. The documentation says that: "GitLab Runner is going to need to talk to your ...
3
votes
0answers
26 views

What are the real world benefits of RDS instance (at rest) encryption?

AWS offers at rest encryption for its RDS instances. I think this sounds nice, and it's something that comes up regularly on security reviews but I'm not sure what the real benefit is. The most likely ...
1
vote
1answer
40 views

Should we deploy Storage Class Per Application OR one Storage Class for All applications?

I am using aws-ebs-csi-driver on k8s for persistent volumes. I came across a scenario where I can create ebs storage class once and then use it across all the statefulsets deployments to create ...
0
votes
0answers
5 views

Manually delete OpenShift cluster; terraform files missing

I have an IPI installed OpenShift cluster in AWS, but I have somehow lost the terraform files associated with that install. I can't run openshift-install destroy cluster without them. How would I best ...
0
votes
0answers
6 views

How to breakout Redshift query duration by each individual query in DataDog?

I am currently working on building a monitoring and alerting system for our infrastructure in DataDog. I made a time series widget showing query duration (aws.redshift.query_duration) filtered to the ...
1
vote
2answers
39 views

AWS EC2: RDP without exposing instance to public

I'm planning to use AWS EC2 instances for the development purpose of my web application. So, I will like to disable all the outbound ports except RDP(3389) port. The RDP port will only be open to a ...
0
votes
1answer
37 views

AWS FARGATE ECS - Exact steps to deploy new Docker images with aws CLI

We run services in AWS FARGATE... our Docker builds are tagged before we push them to AWS with a Makefile. I committed changes to a Docker service, ran make, and I see the new Docker image tag when I ...
2
votes
2answers
40 views

Get a list of remote VPCs on AWS using Terraform?

I'd like to get a list of all remote VPCs from AWS with terraform. I've read the documentation and found two data sources: AWS_DEFAULT_VPC AWS_VPC The first one will give you the default VPC and the ...
0
votes
0answers
3 views

What are some techniques to better maintain a Redshift cluster

We currently have an issue with our Redshift cluster in the sense that we're constantly always running out of space (we have to buy a new node every couple weeks) and query speeds for the same queries ...
2
votes
3answers
43 views

Export AWS RDS mysql Database to S3 Bucket using xtrabackup or any other method

I have an AWS RDS MySQL Database. The size of the Database is around of 1.5 GB. We are using MySQL 5.7.32. We tried with SQL dump but in dump data is missing in Dump. We found out that we can use ...
0
votes
0answers
15 views

How to limit access to internal AWS instances by other services and developers?

I have a dozen instances and lambdas, most of which are not publicly accessible. There are several dozen developers. Everything is currently managed by terraform. I would like to restrict access to ...
0
votes
0answers
30 views

Notify users on failed AWS cognito login and block on multiple failed login

I am looking for the steps to block cognito user after multiple failed login (eg. 3 failed login) and notify via email for each failed login with some details like location or IP of login device. Got ...
1
vote
1answer
29 views

Installing NVIDIA driver on EKS nodes

I have a EKS cluster that has two node pools. One CPU general compute, the other one has GPU support (g4dn). I want to install NVIDIA driver on to the GPU node group. The best I can do right now is to ...
0
votes
0answers
11 views

Redirect traffic to a ALB from AWS VPN endpoint client

I have an internet-facing load balancer, this ALB points to machines with private IP. On the other hand, I have an AWS VPN endpoint, I downloaded the config file, and most importantly I can ssh into ...
1
vote
1answer
25 views

Common permissions for EC2 usage and VPC Security Groups in enterprise use

Context: Looking to create some software that acts as middleware to a user's AWS account, where the user will provide their cloud credentials, and have the software use their EC2 instances. Question: ...
0
votes
1answer
20 views

404 status code in response from Cloudfront for a single page react application

we have a single page app in ReactJS that is being served by CloudFront but the response status continues to be 404 for any nested pages (i.e pages other than the home page). How can this be resolved? ...
1
vote
1answer
26 views

AWS: Restoring database snapshot to different environment

I've a webapp hosted on AWS. This has Electric Beanstalk, with EC2 and then a RDS Postgres database at the bottom. There's prod, UAT and staging environments and databases. I want to take a recent ...
1
vote
0answers
19 views

Native Terraform AWS Auto-Scaling Group Management with health Checks

I have been using CloudFormation for the past 3 years to manage AWS infrastructure which consists of multiple auto-scaling groups with immutable AMIs (amongst other things). I am trying to rewrite ...
1
vote
1answer
90 views

Configure WebSocket on AWS EC2 Load Balancer throws Connection to 'wss://chat.domain.com:8080/' failed

I have built a Websocket on Ubuntu 20.04 (LAMP) stack using Ratchet. I followed this article https://www.twilio.com/blog/create-php-websocket-server-build-real-time-even-driven-application to build ...
0
votes
1answer
20 views

EKS NodeAffinity for Services

https://www.eksworkshop.com/beginner/140_assigning_pods/affinity/ Links like above usually show node affinity for "kind: Pod". Isn't it possible to use node affinity for "kind: Service&...
1
vote
2answers
33 views

kops validate cluster fails with even after providing appropriate state and clustername

I am trying to run validate cluster command as per the documentation kops validate Strangely it fails with following error $ AWS_ACCESS_KEY_ID=<my_legit_key> AWS_SECRET_ACCESS_KEY=<...
1
vote
0answers
11 views

HSM into cloud for windows authenticode signing - Cost benefits vs Security risks?

Our product has 4 apps (Windows, macOS, iOS & Android) with a partially combined build pipeline. 90% is run in the cloud (Android, iOS & macOS are built entirely on cloud infrastructure) but ...
1
vote
1answer
584 views

Nginx Ingress Controller - error creating inClusterConfig

What I'm trying to do I'm trying to get the Nginx controller up and running on my kubernetes cluster with the NLB version of the config files. The problem The ingress-nginx-admission-create and ...
0
votes
1answer
21 views

Resources don't seem to show up in Terraform state after import

I'm in the middle of importing a bunch of AWS resources into Terraform by doing the following: put a stub resource into a .tf file terraform import the resource (using the same address) copy the ...
1
vote
1answer
42 views

Do any services other than EC2s consume ip addresses in AWS?

SCENARIO: I am running out of free ips in my AWS subnets. I would like to talk to my infra team and request them to create new subnets. But they are asking me list of all ips I have consumed so far ...
1
vote
1answer
21 views

How to find the total ips allowed by an AWS subnet?

Is there a way to find how many total ip addresses that an AWS subnet can hold? If my subnet CIDR is a.b.c.d/n, then the total ips allowed in this subnet - are they decided by a, b, c & d as well?
3
votes
1answer
343 views

When to use Apache Airflow (MWAA) in AWS instead of AWS Batch?

I am trying to get a compare and contrast of various job processing services in AWS like AWS Batch, MWAA (Managed Workflow for Apache Airflow). Both are used for processing jobs. Just trying to ...
0
votes
1answer
43 views

Predictive autoscaling on K8s

I am learning about using Machine Learning for provisioning proactive resources on the Kubernetes and I have found some of the interesting articles about it on the internet(for instance for Thoth or ...
2
votes
1answer
35 views

Is there a way to export details of all EC2s in an AWS account?

I am aware there's a Tag Editor in AWS Console which allows us to export details of all EC2s in an AWS account. However that list seems to be missing ami and operating system of the EC2. Is there a ...
1
vote
3answers
209 views

Is AWS Fargate suitable for web applications?

I'm making a web-app, I've tried both ECS and EKS at AWS. It's been very comfortable to use Fargate instances instead of EC2. But I'm not sure I understand how to use them since when I count at it, it'...
0
votes
1answer
192 views

How to Integrate Amazon API Gateway with EKS using Application Load Balancer (ALB)?

According to the AWS documentation, it is possible to integrate Amazon API Gateway with EKS using ALB. However, by far most of this documentation explains how to do this with NLB instead of ALB. So ...
0
votes
1answer
27 views

Is it possible to deploy RDS in multiple region in AWS with read and write replica

I have an application that I need to make it accessible across 4 regions, I saw blogs and other posts in the internet that speaks about the read replica of AWS RDS MySQL Server, is it possible to ...
1
vote
1answer
38 views

AWS ELB Application Load balancer, SSL not working

I've setup an "Application Load balancer" in AWS. It has two Listeners, one on HTTP (port 80) and one on HTTPS (port 443). It also has one target group that with only one FARGATE instance ...
1
vote
1answer
364 views

ansible-playbook: how to dynamically, conditionally set a large deployment environment (variable space) in a playbook?

I am using an ansible playbook to deploy a php web application in aws. The deployment is repeated many times, with a different environment, for each customer. The different scenarios range from ...
0
votes
1answer
77 views

AWS ECS Update with new docker image

I've setup a cluster on AWS ECS, it's hosting nginx and a webapp. I've used these commands to create my resources aws ecr create-repository --repository-name <repo-name> ecs-cli configure --...
1
vote
1answer
61 views

How CircleCI, Terraform and AWS should interact in CI/CD Pipeline

I'm new to devops and I'm have a hard time finding resources to help me with this question. My Goal is to have an automated CI/CD pipeline to launch my project. Basically I have a GitHub repo with a ...
1
vote
2answers
295 views

Container Image Promotion across environments in ECR/ECS

We have started doing some initial work on deploying containers on ECS Fargate service. However we are not yet completely figured out how to manage our image promotion across different environments. ...
0
votes
1answer
97 views

Unexpected type error in ansible community.aws.cloudfront_distribution: "origins" parameter: "'list' object has no attribute 'get'"

I get an unexpected type error, for what I assume to be the "origins" argument to the community.aws.cloudfront_distribution module: "Error validating distribution origins: 'list' object ...
0
votes
1answer
88 views

Advantages of using Code-pipeline and Codebuild for CI/CD over Bitbucket pipeline?

What are the advantages of using AWS Codepipeline/code build for our pipeline over the bitbucket pipeline. ? Some of the factors that I can think of: Pricing? Pipeline for a serverless application ...
0
votes
1answer
445 views

AWS ElastiCache Redis DNS error - Name or service not known

The Problem & The Question I'm trying to create an AWS ElastiCache Redis-flavored cluster and connect to it from an instance in the same VPC. When I create the cluster initially, I can connect to ...
0
votes
2answers
42 views

How to get code onto aws ec2 instance using terraform and gitlabs

I've just started learning Terraform (utilizing the AWS provider) and I have managed to replicate our infrastructure which includes quite a few amazon web services. I can successfully deploy it and ...
1
vote
0answers
15 views

Cost minimization in aws parallel cluster

I'm new to aws cloud service. I have to create a parallel cluster in aws. So, I'm using aws parallel cluster. But the problem is, when creating a cluster the NAT gateway billing me when I'm not using ...
0
votes
1answer
253 views

Gitlab CI/CD: deploy docker image to existing kubernetes cluster

I have node.js application that I need to deploy to exising kubernetes cluster. The cluster is setup using kops on AWS. I have created .gitlab-ci.yml file for building docker images. So, whenever a ...
1
vote
1answer
32 views

AWS Inspector "High Risk" : port open to the internet with IP whitelisting

We use AWS Inspector to identify risks with our AWS assets. Today I received a finding, with a "high" severity. The finding said that the FTP port was open to the internet. However, after ...

1
2 3 4 5
9