Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

Filter by
Sorted by
Tagged with
0
votes
0answers
6 views

How to setup JFrog remote repositories?

We use jfrog artifactory for storing binaries We use lot of third party tools like openjdk, python etc. Can we use jfrog remote repositories to safely download latest version of all these 3rd party ...
0
votes
1answer
30 views

Terraform: add to existing AWS policy, or create policy if needed

Several of our terraform root modules need add to an existing policy that provides read-only permissions for S3 buckets -- each module has its own bucket. I cannot figure out how to add to the ...
2
votes
1answer
38 views

How to auto generate a diagram out of my AWS VPC?

Does AWS provide a tool to visualize my VPC? I would like to generate an image file with all services (shown as icons) provisioned inside a VPC. Tools like draw.io and others are available. But doesnt ...
2
votes
1answer
25 views

What are minimum permissions required for an IAM user to provision EC2 instances?

I want to provision an EC2 instance with Ansible. So for that purpose I want to create a separate IAM user to keep things clear. I can assign the full EC2 access to the user. But I don't want any ...
0
votes
0answers
2 views

Regional server read from nearby MongoDB cluster node and write to remote MongoDB master

We plan to set up a global MongoDB cluster across 2 different data centers. The MongoDB master will be inside the AWS China data center and there will be a read-only node in AWS Singapore. How do we ...
1
vote
1answer
35 views

Where to get OS Hardening Scripts for CIS Hardening Standards?

CIS provides benchmarks for hardening OS on AWS CIS also provides images which meet their own benchmarks above These CIS images are available here - https://www.cisecurity.org/blog/everything-you-need-...
1
vote
2answers
34 views

Set up Mongo Cluster across 2 data centers with writing enabled on both

We're planning to expand our software to the South East Asia region. A self-hosted Mongo Cluster is fully set up at China's AWS Data Center. How can we set up the MongoDB replicate set to AWS ...
0
votes
0answers
33 views

Terraform/AWS Macie: how to use managed data identifiers?

I am trying to enable AWS Macie via Terraform to run scheduled jobs that scan S3 buckets for sensitive data. I've been able to create an account and execute an initial scan of my buckets, but I would ...
1
vote
1answer
37 views

How to mount EC2 intances to AWS EFS via Terraform [closed]

I'm trying to Terraform a few EC2 instances, and would like to automate the provisioning steps that involve mounting their filesystems to EFS. The commands to run this manually are as follows: $ sudo ...
0
votes
0answers
24 views

Terraform cannot destroy with EBS volume attached

to detach from Instance (): unexpected state 'busy', wanted target 'detached'. last error: %!s(<nil>) I get the above error when I try to run terraform destroy. I think the ebs volume must be ...
1
vote
0answers
23 views

Launching VM instances only when needed

I am looking for the right tool to launch VM instances on a cloud platform only when I need them. Once launched, they should run a containerized script (let's call it a job) that runs for about 5 to ...
0
votes
0answers
25 views

Gitlab (self hosted gitlab) pipeline fail when trying to fetch repository

I've setup own gitlab server on AWS EC2 Instance based on this image - https://aws.amazon.com/marketplace/pp/prodview-w6ykryurkesjq?ref_=aws-mp-console-subscription-detail and assign Elastic IP for ...
-1
votes
1answer
41 views

How many nodes can I have in single EKS cluster?

I have an EKS cluster and today my subnet had 0 Available IPv4 addresses. Does that mean that there are limits per nodes within 1 cluster in EKS?
0
votes
0answers
24 views

Can an autoscaling group use both target tracking and scheduled policies?

I have an ECS cluster I'm deploying Docker images to using Fargate as the runtime. The containers run a process that consumes from a message broker queue. We'd like to define an autoscaling group that ...
0
votes
0answers
16 views

Connect Docker Swarm to AWS Application Load Balancer

What is the best practice to connect a Docker Swarm that is deployed in EC2 with an Application Load Balancer? In my configuration the ALB is what Route53 resolves to. The Docker Swarm is configured ...
2
votes
1answer
25 views

Do GitLab Runner worker nodes need to have network access to GitLab?

GitLab runner has an autoscale feature that allows the Runner Manager to dynamically spawn new worker nodes on demand. The documentation says that: "GitLab Runner is going to need to talk to your ...
3
votes
0answers
26 views

What are the real world benefits of RDS instance (at rest) encryption?

AWS offers at rest encryption for its RDS instances. I think this sounds nice, and it's something that comes up regularly on security reviews but I'm not sure what the real benefit is. The most likely ...
1
vote
1answer
45 views

Should we deploy Storage Class Per Application OR one Storage Class for All applications?

I am using aws-ebs-csi-driver on k8s for persistent volumes. I came across a scenario where I can create ebs storage class once and then use it across all the statefulsets deployments to create ...
0
votes
0answers
6 views

Manually delete OpenShift cluster; terraform files missing

I have an IPI installed OpenShift cluster in AWS, but I have somehow lost the terraform files associated with that install. I can't run openshift-install destroy cluster without them. How would I best ...
0
votes
0answers
8 views

How to breakout Redshift query duration by each individual query in DataDog?

I am currently working on building a monitoring and alerting system for our infrastructure in DataDog. I made a time series widget showing query duration (aws.redshift.query_duration) filtered to the ...
1
vote
2answers
42 views

AWS EC2: RDP without exposing instance to public

I'm planning to use AWS EC2 instances for the development purpose of my web application. So, I will like to disable all the outbound ports except RDP(3389) port. The RDP port will only be open to a ...
0
votes
1answer
37 views

AWS FARGATE ECS - Exact steps to deploy new Docker images with aws CLI

We run services in AWS FARGATE... our Docker builds are tagged before we push them to AWS with a Makefile. I committed changes to a Docker service, ran make, and I see the new Docker image tag when I ...
2
votes
2answers
69 views

Get a list of remote VPCs on AWS using Terraform?

I'd like to get a list of all remote VPCs from AWS with terraform. I've read the documentation and found two data sources: AWS_DEFAULT_VPC AWS_VPC The first one will give you the default VPC and the ...
0
votes
0answers
3 views

What are some techniques to better maintain a Redshift cluster

We currently have an issue with our Redshift cluster in the sense that we're constantly always running out of space (we have to buy a new node every couple weeks) and query speeds for the same queries ...
2
votes
3answers
80 views

Export AWS RDS mysql Database to S3 Bucket using xtrabackup or any other method

I have an AWS RDS MySQL Database. The size of the Database is around of 1.5 GB. We are using MySQL 5.7.32. We tried with SQL dump but in dump data is missing in Dump. We found out that we can use ...
0
votes
0answers
15 views

How to limit access to internal AWS instances by other services and developers?

I have a dozen instances and lambdas, most of which are not publicly accessible. There are several dozen developers. Everything is currently managed by terraform. I would like to restrict access to ...
0
votes
0answers
59 views

Notify users on failed AWS cognito login and block on multiple failed login

I am looking for the steps to block cognito user after multiple failed login (eg. 3 failed login) and notify via email for each failed login with some details like location or IP of login device. Got ...
1
vote
1answer
33 views

Installing NVIDIA driver on EKS nodes

I have a EKS cluster that has two node pools. One CPU general compute, the other one has GPU support (g4dn). I want to install NVIDIA driver on to the GPU node group. The best I can do right now is to ...
0
votes
0answers
12 views

Redirect traffic to a ALB from AWS VPN endpoint client

I have an internet-facing load balancer, this ALB points to machines with private IP. On the other hand, I have an AWS VPN endpoint, I downloaded the config file, and most importantly I can ssh into ...
1
vote
1answer
25 views

Common permissions for EC2 usage and VPC Security Groups in enterprise use

Context: Looking to create some software that acts as middleware to a user's AWS account, where the user will provide their cloud credentials, and have the software use their EC2 instances. Question: ...
0
votes
1answer
24 views

404 status code in response from Cloudfront for a single page react application

we have a single page app in ReactJS that is being served by CloudFront but the response status continues to be 404 for any nested pages (i.e pages other than the home page). How can this be resolved? ...
1
vote
1answer
31 views

AWS: Restoring database snapshot to different environment

I've a webapp hosted on AWS. This has Electric Beanstalk, with EC2 and then a RDS Postgres database at the bottom. There's prod, UAT and staging environments and databases. I want to take a recent ...
1
vote
0answers
22 views

Native Terraform AWS Auto-Scaling Group Management with health Checks

I have been using CloudFormation for the past 3 years to manage AWS infrastructure which consists of multiple auto-scaling groups with immutable AMIs (amongst other things). I am trying to rewrite ...
1
vote
1answer
125 views

Configure WebSocket on AWS EC2 Load Balancer throws Connection to 'wss://chat.domain.com:8080/' failed

I have built a Websocket on Ubuntu 20.04 (LAMP) stack using Ratchet. I followed this article https://www.twilio.com/blog/create-php-websocket-server-build-real-time-even-driven-application to build ...
0
votes
1answer
22 views

EKS NodeAffinity for Services

https://www.eksworkshop.com/beginner/140_assigning_pods/affinity/ Links like above usually show node affinity for "kind: Pod". Isn't it possible to use node affinity for "kind: Service&...
1
vote
2answers
47 views

kops validate cluster fails with even after providing appropriate state and clustername

I am trying to run validate cluster command as per the documentation kops validate Strangely it fails with following error $ AWS_ACCESS_KEY_ID=<my_legit_key> AWS_SECRET_ACCESS_KEY=<...
1
vote
0answers
11 views

HSM into cloud for windows authenticode signing - Cost benefits vs Security risks?

Our product has 4 apps (Windows, macOS, iOS & Android) with a partially combined build pipeline. 90% is run in the cloud (Android, iOS & macOS are built entirely on cloud infrastructure) but ...
1
vote
1answer
862 views

Nginx Ingress Controller - error creating inClusterConfig

What I'm trying to do I'm trying to get the Nginx controller up and running on my kubernetes cluster with the NLB version of the config files. The problem The ingress-nginx-admission-create and ...
0
votes
1answer
21 views

Resources don't seem to show up in Terraform state after import

I'm in the middle of importing a bunch of AWS resources into Terraform by doing the following: put a stub resource into a .tf file terraform import the resource (using the same address) copy the ...
1
vote
1answer
45 views

Do any services other than EC2s consume ip addresses in AWS?

SCENARIO: I am running out of free ips in my AWS subnets. I would like to talk to my infra team and request them to create new subnets. But they are asking me list of all ips I have consumed so far ...
1
vote
1answer
22 views

How to find the total ips allowed by an AWS subnet?

Is there a way to find how many total ip addresses that an AWS subnet can hold? If my subnet CIDR is a.b.c.d/n, then the total ips allowed in this subnet - are they decided by a, b, c & d as well?
3
votes
1answer
454 views

When to use Apache Airflow (MWAA) in AWS instead of AWS Batch?

I am trying to get a compare and contrast of various job processing services in AWS like AWS Batch, MWAA (Managed Workflow for Apache Airflow). Both are used for processing jobs. Just trying to ...
0
votes
1answer
50 views

Predictive autoscaling on K8s

I am learning about using Machine Learning for provisioning proactive resources on the Kubernetes and I have found some of the interesting articles about it on the internet(for instance for Thoth or ...
3
votes
1answer
41 views

Is there a way to export details of all EC2s in an AWS account?

I am aware there's a Tag Editor in AWS Console which allows us to export details of all EC2s in an AWS account. However that list seems to be missing ami and operating system of the EC2. Is there a ...
1
vote
3answers
311 views

Is AWS Fargate suitable for web applications?

I'm making a web-app, I've tried both ECS and EKS at AWS. It's been very comfortable to use Fargate instances instead of EC2. But I'm not sure I understand how to use them since when I count at it, it'...
1
vote
1answer
283 views

How to Integrate Amazon API Gateway with EKS using Application Load Balancer (ALB)?

According to the AWS documentation, it is possible to integrate Amazon API Gateway with EKS using ALB. However, by far most of this documentation explains how to do this with NLB instead of ALB. So ...
0
votes
1answer
28 views

Is it possible to deploy RDS in multiple region in AWS with read and write replica

I have an application that I need to make it accessible across 4 regions, I saw blogs and other posts in the internet that speaks about the read replica of AWS RDS MySQL Server, is it possible to ...
1
vote
1answer
43 views

AWS ELB Application Load balancer, SSL not working

I've setup an "Application Load balancer" in AWS. It has two Listeners, one on HTTP (port 80) and one on HTTPS (port 443). It also has one target group that with only one FARGATE instance ...
1
vote
1answer
389 views

ansible-playbook: how to dynamically, conditionally set a large deployment environment (variable space) in a playbook?

I am using an ansible playbook to deploy a php web application in aws. The deployment is repeated many times, with a different environment, for each customer. The different scenarios range from ...
0
votes
1answer
84 views

AWS ECS Update with new docker image

I've setup a cluster on AWS ECS, it's hosting nginx and a webapp. I've used these commands to create my resources aws ecr create-repository --repository-name <repo-name> ecs-cli configure --...

1
2 3 4 5
9