Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

Filter by
Sorted by
Tagged with
9
votes
4answers
12k views

Jenkins installed on aws unable to launch on browser

I have a fresh aws instance with Ubuntu 14 installed. I am trying to install and run jenkins on it. I did the following steps. Installed java8 wget -q -O - https://pkg.jenkins.io/debian/jenkins-...
0
votes
1answer
165 views

Export CloudFormation file from CDK

Since I've seen Hashicorp Terraform, I have been wondering why the "plan" it can export has binary format. Now in the AWS world you have got a declarative configuration language called ...
0
votes
1answer
30 views

Terraform: add to existing AWS policy, or create policy if needed

Several of our terraform root modules need add to an existing policy that provides read-only permissions for S3 buckets -- each module has its own bucket. I cannot figure out how to add to the ...
2
votes
1answer
38 views

How to auto generate a diagram out of my AWS VPC?

Does AWS provide a tool to visualize my VPC? I would like to generate an image file with all services (shown as icons) provisioned inside a VPC. Tools like draw.io and others are available. But doesnt ...
0
votes
0answers
6 views

How to setup JFrog remote repositories?

We use jfrog artifactory for storing binaries We use lot of third party tools like openjdk, python etc. Can we use jfrog remote repositories to safely download latest version of all these 3rd party ...
2
votes
1answer
25 views

Do GitLab Runner worker nodes need to have network access to GitLab?

GitLab runner has an autoscale feature that allows the Runner Manager to dynamically spawn new worker nodes on demand. The documentation says that: "GitLab Runner is going to need to talk to your ...
2
votes
1answer
25 views

What are minimum permissions required for an IAM user to provision EC2 instances?

I want to provision an EC2 instance with Ansible. So for that purpose I want to create a separate IAM user to keep things clear. I can assign the full EC2 access to the user. But I don't want any ...
1
vote
2answers
34 views

Set up Mongo Cluster across 2 data centers with writing enabled on both

We're planning to expand our software to the South East Asia region. A self-hosted Mongo Cluster is fully set up at China's AWS Data Center. How can we set up the MongoDB replicate set to AWS ...
0
votes
0answers
2 views

Regional server read from nearby MongoDB cluster node and write to remote MongoDB master

We plan to set up a global MongoDB cluster across 2 different data centers. The MongoDB master will be inside the AWS China data center and there will be a read-only node in AWS Singapore. How do we ...
1
vote
2answers
778 views

Why do I need a Nat Gateway for ECS containers using AWSVPC?

So here is a scenario: I have a route table that routes all traffic to the internet gateway, and I have a subnet associated with that route table, which makes it a public subnet. Now I create another ...
1
vote
1answer
35 views

Where to get OS Hardening Scripts for CIS Hardening Standards?

CIS provides benchmarks for hardening OS on AWS CIS also provides images which meet their own benchmarks above These CIS images are available here - https://www.cisecurity.org/blog/everything-you-need-...
1
vote
1answer
37 views

How to mount EC2 intances to AWS EFS via Terraform [closed]

I'm trying to Terraform a few EC2 instances, and would like to automate the provisioning steps that involve mounting their filesystems to EFS. The commands to run this manually are as follows: $ sudo ...
0
votes
0answers
33 views

Terraform/AWS Macie: how to use managed data identifiers?

I am trying to enable AWS Macie via Terraform to run scheduled jobs that scan S3 buckets for sensitive data. I've been able to create an account and execute an initial scan of my buckets, but I would ...
1
vote
1answer
45 views

Should we deploy Storage Class Per Application OR one Storage Class for All applications?

I am using aws-ebs-csi-driver on k8s for persistent volumes. I came across a scenario where I can create ebs storage class once and then use it across all the statefulsets deployments to create ...
0
votes
0answers
24 views

Terraform cannot destroy with EBS volume attached

to detach from Instance (): unexpected state 'busy', wanted target 'detached'. last error: %!s(<nil>) I get the above error when I try to run terraform destroy. I think the ebs volume must be ...
1
vote
0answers
23 views

Launching VM instances only when needed

I am looking for the right tool to launch VM instances on a cloud platform only when I need them. Once launched, they should run a containerized script (let's call it a job) that runs for about 5 to ...
0
votes
0answers
24 views

Can an autoscaling group use both target tracking and scheduled policies?

I have an ECS cluster I'm deploying Docker images to using Fargate as the runtime. The containers run a process that consumes from a message broker queue. We'd like to define an autoscaling group that ...
-1
votes
1answer
41 views

How many nodes can I have in single EKS cluster?

I have an EKS cluster and today my subnet had 0 Available IPv4 addresses. Does that mean that there are limits per nodes within 1 cluster in EKS?
0
votes
0answers
25 views

Gitlab (self hosted gitlab) pipeline fail when trying to fetch repository

I've setup own gitlab server on AWS EC2 Instance based on this image - https://aws.amazon.com/marketplace/pp/prodview-w6ykryurkesjq?ref_=aws-mp-console-subscription-detail and assign Elastic IP for ...
0
votes
0answers
16 views

Connect Docker Swarm to AWS Application Load Balancer

What is the best practice to connect a Docker Swarm that is deployed in EC2 with an Application Load Balancer? In my configuration the ALB is what Route53 resolves to. The Docker Swarm is configured ...
0
votes
1answer
37 views

AWS FARGATE ECS - Exact steps to deploy new Docker images with aws CLI

We run services in AWS FARGATE... our Docker builds are tagged before we push them to AWS with a Makefile. I committed changes to a Docker service, ran make, and I see the new Docker image tag when I ...
2
votes
1answer
60 views

SFTP server with third party user management system?

I understand how to set up SFTP servers on Linux and create users and their passwords manually. So basically, the users get authenticated as normal Linux users get authenticated through /etc/passwd. ...
3
votes
0answers
26 views

What are the real world benefits of RDS instance (at rest) encryption?

AWS offers at rest encryption for its RDS instances. I think this sounds nice, and it's something that comes up regularly on security reviews but I'm not sure what the real benefit is. The most likely ...
1
vote
1answer
211 views

In the AWS CLI how do I treat a special character as a string?

I'm trying to run an AWS CLI command for a resource with a ! in its name. I'm doing this from Centos docker instance running on my local device a MAC and if I run echo "$SHELL" it says it ...
2
votes
1answer
2k views

Terraform error Reference to “count” in non-counted context for resources not necessarily data

here's my part of my code that I am having issues with. Unfortunately I could not understand the relationship between the last answer, despite being almost what I need, and my situation. data "...
0
votes
0answers
6 views

Manually delete OpenShift cluster; terraform files missing

I have an IPI installed OpenShift cluster in AWS, but I have somehow lost the terraform files associated with that install. I can't run openshift-install destroy cluster without them. How would I best ...
0
votes
0answers
8 views

How to breakout Redshift query duration by each individual query in DataDog?

I am currently working on building a monitoring and alerting system for our infrastructure in DataDog. I made a time series widget showing query duration (aws.redshift.query_duration) filtered to the ...
1
vote
2answers
42 views

AWS EC2: RDP without exposing instance to public

I'm planning to use AWS EC2 instances for the development purpose of my web application. So, I will like to disable all the outbound ports except RDP(3389) port. The RDP port will only be open to a ...
0
votes
1answer
361 views

kube-controller-manager unable to communicate with etcd

1. What kops version are you running? The command kops version, will display this information. Version 1.12.2 2. What Kubernetes version are you running? kubectl version will print the version if a ...
11
votes
1answer
2k views

How to support releasing new versions of the code, running in parallel with the last stable release?

I have one service in production (on AWS), which follows the immutable server pattern. Its deployment looks like this: Create a new AMI with Packer. Create a new CloudFormation stack, starting with ...
1
vote
0answers
262 views

The deployment failed because no instances were found in your green fleet

I have created a blue-green deployment in AWS CodeDeploy with the option Manually provision instances. but when I run pipeline code deploy show error `The deployment failed because no instances were ...
4
votes
2answers
2k views

Cancel a Spot Request vs Terminate Spot Instance

I just started getting familiar with EC2's Spot Requests and Spot Instances (1 day into it!). I understand that I can save some money doing a Spot Request to create a Spot Instance as opposed to ...
3
votes
1answer
454 views

When to use Apache Airflow (MWAA) in AWS instead of AWS Batch?

I am trying to get a compare and contrast of various job processing services in AWS like AWS Batch, MWAA (Managed Workflow for Apache Airflow). Both are used for processing jobs. Just trying to ...
2
votes
2answers
69 views

Get a list of remote VPCs on AWS using Terraform?

I'd like to get a list of all remote VPCs from AWS with terraform. I've read the documentation and found two data sources: AWS_DEFAULT_VPC AWS_VPC The first one will give you the default VPC and the ...
0
votes
1answer
24 views

404 status code in response from Cloudfront for a single page react application

we have a single page app in ReactJS that is being served by CloudFront but the response status continues to be 404 for any nested pages (i.e pages other than the home page). How can this be resolved? ...
2
votes
3answers
80 views

Export AWS RDS mysql Database to S3 Bucket using xtrabackup or any other method

I have an AWS RDS MySQL Database. The size of the Database is around of 1.5 GB. We are using MySQL 5.7.32. We tried with SQL dump but in dump data is missing in Dump. We found out that we can use ...
1
vote
1answer
125 views

Configure WebSocket on AWS EC2 Load Balancer throws Connection to 'wss://chat.domain.com:8080/' failed

I have built a Websocket on Ubuntu 20.04 (LAMP) stack using Ratchet. I followed this article https://www.twilio.com/blog/create-php-websocket-server-build-real-time-even-driven-application to build ...
0
votes
0answers
3 views

What are some techniques to better maintain a Redshift cluster

We currently have an issue with our Redshift cluster in the sense that we're constantly always running out of space (we have to buy a new node every couple weeks) and query speeds for the same queries ...
2
votes
1answer
1k views

CodeDeploy: deployment failed because a specified file already exists at this location

I build an AMI from a 'prototype' EC2 instance I created to confirm everything is working. I create a Launch Configuration and Auto Scaling Group based on the AMI. I associate the Auto Scaling Group ...
0
votes
0answers
15 views

How to limit access to internal AWS instances by other services and developers?

I have a dozen instances and lambdas, most of which are not publicly accessible. There are several dozen developers. Everything is currently managed by terraform. I would like to restrict access to ...
1
vote
1answer
33 views

Installing NVIDIA driver on EKS nodes

I have a EKS cluster that has two node pools. One CPU general compute, the other one has GPU support (g4dn). I want to install NVIDIA driver on to the GPU node group. The best I can do right now is to ...
0
votes
0answers
59 views

Notify users on failed AWS cognito login and block on multiple failed login

I am looking for the steps to block cognito user after multiple failed login (eg. 3 failed login) and notify via email for each failed login with some details like location or IP of login device. Got ...
0
votes
0answers
12 views

Redirect traffic to a ALB from AWS VPN endpoint client

I have an internet-facing load balancer, this ALB points to machines with private IP. On the other hand, I have an AWS VPN endpoint, I downloaded the config file, and most importantly I can ssh into ...
6
votes
3answers
903 views

Terraform AWS AZ error - manually specify AZ?

I'm fairly new to terraform and when creating AWS infrastructure I use the following to fetch the 'available' availability zones for my region (us-east-1) where I'm trying to create an EKS cluster. ...
1
vote
1answer
25 views

Common permissions for EC2 usage and VPC Security Groups in enterprise use

Context: Looking to create some software that acts as middleware to a user's AWS account, where the user will provide their cloud credentials, and have the software use their EC2 instances. Question: ...
1
vote
1answer
31 views

AWS: Restoring database snapshot to different environment

I've a webapp hosted on AWS. This has Electric Beanstalk, with EC2 and then a RDS Postgres database at the bottom. There's prod, UAT and staging environments and databases. I want to take a recent ...
0
votes
1answer
4k views

Ansible playbook error: "Connection timed out during banner exchange"

I am trying to connect to my bastion host and then tunnel that ssh connection to connect to a jenkins host but keep running into the connection timed out error. The error message in full is: fatal: [&...
1
vote
0answers
22 views

Native Terraform AWS Auto-Scaling Group Management with health Checks

I have been using CloudFormation for the past 3 years to manage AWS infrastructure which consists of multiple auto-scaling groups with immutable AMIs (amongst other things). I am trying to rewrite ...
0
votes
1answer
22 views

EKS NodeAffinity for Services

https://www.eksworkshop.com/beginner/140_assigning_pods/affinity/ Links like above usually show node affinity for "kind: Pod". Isn't it possible to use node affinity for "kind: Service&...
6
votes
4answers
5k views

How do I run Terraform with AWS MFA?

I'm using Terraform with the terraform-provider-aws provider to manage my AWS infrastructure. I'm trying to enable mfa_delete on an S3 bucket, but when I try to apply the change I get this error: 1 ...

1
2 3 4 5
9