Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

Filter by
Sorted by
Tagged with
5
votes
1answer
1k views

How does the creation of an AMI on AWS work and why is the creation time unpredictable?

Creation date: September 23, 2019 at 9:22:06 PM UTC+2 21:48: still waiting for completion 21:53: completed Sometimes it takes 15 minutes and sometimes longer. How does a creation of an AMI work and ...
5
votes
1answer
4k views

How do I write a buildspec.yml file?

I have Java Spring web service project on EC2 I tried writing a buildspec.yml for it. However the AWS CodeBuild service is not giving successful results. In the install phase itself, it tells apt-...
5
votes
1answer
5k views

How to apply using Terraform to launch multiple EC2 Resource with different configs (VPC not maintained by TF)

We are planning to use Terraform for provisioning EC2 instance which will host Oracle DB. While we are able to achieve this, there are some questions for which I am searching for suggestions / ...
5
votes
1answer
1k views

How to implement blue-green deployment with one master branch

I was told that they easy way out is to have two production branches, master/blue and master/green, git merge action triggers CI to deploy to the matching stacks. Is that possible to do it with single ...
5
votes
3answers
1k views

How to monitor AWS S3 cross-region replication process?

Amazon S3 has a cross-region replication which will handle copy of new/updated objects to additional region. The problem is that solution does not provide visibility on state for replication process, ...
5
votes
3answers
3k views

How do I run Terraform with AWS MFA?

I'm using Terraform with the terraform-provider-aws provider to manage my AWS infrastructure. I'm trying to enable mfa_delete on an S3 bucket, but when I try to apply the change I get this error: 1 ...
5
votes
2answers
1k views

How to automate rolling upgrades for ec2 running linux behind elastic and/or application load balancer?

Would like to ask for recommendations on ready automated solutions or templates for rolling ec2 instance upgrade on AWS, requiring a reboot with ELB/ALB. Specifically required to perform the ...
5
votes
2answers
886 views

How to `terraform destroy` an `aws_instance` without also destroying its `aws_ebs_volume` (separate resource)

$ terraform -version Terraform v0.12.21 + provider.aws v2.34.0 Given a terraform configuration for one set of single aws_instance, aws_ebs_volume and aws_volume_attachment resources, each named, say,...
5
votes
3answers
2k views

DevOps SOX Compliance

I'm coming from the dark side, compliance, and am looking to gain better knowledge on DevOps & how to implement SOX controls on these processes. I'm hoping to build a good knowledge base in order ...
5
votes
1answer
132 views

Wordpress on AWS, how to update only a theme

In order to setup a flow from developer code to a public URL, I've been testing some flows and the current one does not work that good: I have an AWS Pipeline that picks up the source code from ...
5
votes
2answers
2k views

Monitor Jenkins node/slave health

For a project I'm working on, we need to create a Jenkins node in an AWS environment. For this task, we will work with the docker image, which is available on https://github.com/jenkinsci/docker-ssh-...
5
votes
0answers
3k views

Is it possible to create AWS CloudWatch Metric Filters with dimensions? [closed]

CloudWatch Metric Filters are the recommended way to create custom metrics from Lambda functions. Sending the metrics directly from the lambda function to the CloudWatch api is the main alternative, ...
4
votes
4answers
1k views

How to see when an AWS IAM role was last used?

In AWS in the GUI you can select a role and then click on delete, then when you are prompted to approve or deny the deletion it shows you when the role was last used. I would like to be able to know ...
4
votes
4answers
220 views

DevOps tools and automation of manual processes

This is a general question, but couldn't find a better place to ask. I'm a new DevOps member in a company, and I've been ask to "update" our DevOps technologies. Generally speaking, in what areas do ...
4
votes
3answers
93 views

Ideal methods of handling server logs on AWS

We currently have some ruby applications hosted on EC2 servers on AWS, and every few weeks we see the disk space get completely consumed by the app log as well as the worker logs. What are the best ...
4
votes
2answers
515 views

Impact on policy after deleting IAM user

I have created one IAM User named "test" with S3 and Glacier Permission. Now with user "test" i created one life cycle policy to move data from S3 to Glacier at every 5 days. Now, i delete IAM user "...
4
votes
2answers
911 views

LambdaA -> delay mins -> lambdaB

I need to launch a LambdaA function and after X minutes I need to launch a LambdaB function with parameters passed from LamdaA I have testing the following: APIGW > LambdaA > SQS with delay > SQS ...
4
votes
2answers
46 views

One NAT attachment for two private subnets

I have two NAT gateway attachments for two private subnets in AWS. Is it possible to have one NAT gateway attachment for two private subnets so that I can save one EIP?
4
votes
3answers
1k views

Amazon EKS from local kubectl does not cache MFA token/session

I have set up an EKS cluster in AWS. My user-account there is secured with MFA. And I have an assumerole, that is allowed to manage my infrastructure. So I installed and configured my system as ...
4
votes
1answer
226 views

difference between packer and matchbox

I have this setup to standup a baremetal machine: Terraform-> Matchbox \-> Chef-> Docker My colleague has a setup to standup VMs in AWS: Terraform-> Packer-> Chef-> ...
4
votes
1answer
1k views

parameter-store values show '***' instead of actual value

I am using CodeBuild to access the Systems Manager Parameter Store. In buildspec.yml, I have the parameter-store configured to access some values in Systems Manager (I certainly have the /mysite/dev/...
4
votes
1answer
1k views

Trying to make job working AWS MediaConvert (ERROR 1040)

Here is my json job. { "Queue": "arn:aws:mediaconvert:xxxxx", "UserMetadata": {}, "Role": "xxxxx:role/MediaConvert", "Settings": { "TimecodeConfig": { "Source": "EMBEDDED" }, ...
4
votes
2answers
78 views

AWS or Azure with usage auto shutdown occasional usage

I'm looking for recommendations on which cloud service provider we should be looking at. The situation: I'm part of a small team looking to leverage more powerful analytics. Most of our day to day ...
4
votes
1answer
4k views

AllowedPattern for emails in Cloudformation template

I am struggling with specifying a regular expression for email parameter of Cloudformation : Parameters: MyEmail : Type: String Description: Email for notifications AllowedPattern: /[^\...
4
votes
1answer
82 views

Teaching an old dog new tricks: Finally adopting the micro-service architecture

Is it too late to teach an old dog a new trick? I've always been the guy with a monolithic application/codebase. For more than 10 years now, I've gotten good at caching, writing good SQL queries, ...
4
votes
1answer
97 views

How to route to specific, of multiple datacenters, with a single domain

The data of each customer only exist in one of several global datacenters, that all answer to the same hostname (ex. api.company.com) Only a single domain for all customers globally I want to make ...
4
votes
2answers
1k views

Where to start? Scaling PHP applications on AWS

Currently all of our PHP (Laravel) applications are running on one EC2 instance. To deploy code, we SSH onto the live box and pull from CodeCommit. We now need to scale and deploy properly. I'm not ...
4
votes
1answer
458 views

What's the benefit of using Nginx to serve a Flask API on AWS?

I want to deploy a Flask API on AWS using Docker. A common way seems to be using a combination of Nginx + app server (e.g Gunicorn) + Flask app. The reason to use app server seems obvious to me. ...
4
votes
2answers
1k views

Cancel a Spot Request vs Terminate Spot Instance

I just started getting familiar with EC2's Spot Requests and Spot Instances (1 day into it!). I understand that I can save some money doing a Spot Request to create a Spot Instance as opposed to ...
4
votes
1answer
1k views

Running a command as a specific user on an ec2 using ssm

Background I want to automatically configure an EC2 via a build, using the aws cli and ssm. The (manual) setup for the container looks something like this: Create an EC2 Run a shell script as root ...
4
votes
1answer
260 views

AWS SQS - use case for “short polling”

When using event driven processing of work with AWS SQS and worker clients. the use of long polling is often recommended. AWS documents this here Essentially when there are no message in the queue, ...
4
votes
1answer
158 views

Triggering a SNS notification when an object is accessed (downloaded) in AWS S3

I have managed to trigger events on my bucket when objects are uploaded (PUT) but I am surprised that there are no triggers called when objects are downloaded (GETs), as can be seen in this screenshot ...
4
votes
1answer
263 views

AWS CodePipeline staged deployments

I am implementing a CICD pipeline using CodePipeline, CodeCommit, CodeDeploy and CloudFormation (I skipped the build part of the pipeline and am going to commit built code for the moment). I already ...
4
votes
3answers
769 views

Challenges of using AWS Lambda chain

Context: I have a pipeline of 6 lambda functions (chained together), triggered by an SNS notification which is generated whenever a file lands on S3. This pipeline essentially takes the file(few GBs), ...
4
votes
1answer
775 views

How to provide multiple configs for EC2 node using Terraform and cloud-init?

I need to use several configs on my EC2 node using Terraform. data "template_cloudinit_config" "puppetserver_config" { gzip = true base64_encode = true part { ...
4
votes
2answers
2k views

Jenkins configuration to support multi-config multi-branch CI

Here are my requirements and I go back-and-forth on how to achieve them: Must build Java spring-boot apps Artifacts must be released to artifactory repository Docker image to be built directly ...
4
votes
1answer
64 views

Trade offs of putting an international master database in us-west-2

I'm hoping this isn't so open ended that it veers towards a "discussion" more than an "answerable" question. I need to place an RDS Postgres instance in an AWS region that will act as the master DB ...
4
votes
1answer
112 views

Docker managers are losing quorum on AWS

I have deployed Docker EE on AWS by choosing the package directly from the AWS Marketplace: Docker EE for AWS (Standard/Advanced) - BYOL. The cluster has been successfully launched and deployed on AWS....
4
votes
1answer
877 views

Create multiple EC2 instances using python script (in loop iteration)

I Have JSON file in which email address and count of instances are specified.I'm using python script to iterate through that file and get username/count number (count number will be used as number of ...
4
votes
1answer
639 views

Github commit message when deploying to aws beanstalk in Jenkins

As part of our CI setup I am using AWS Beanstalk deployment plugin to deploy my application through Jenkins. The issue is I am getting git commit hash in beanstalk application versions description. I ...
4
votes
1answer
73 views

Looking for ways to host application in AWS and have it monitored using opensource

I am a newbie in the world of DevOps and have been assigned a task to implement web applications for the customers in AWS and that application monitored (security, metrics and logging) using any of ...
3
votes
3answers
154 views

Should compilers be kept in artifactory?

We are setting up our source and build system in AWS. we will have two persistent VMs hosting source and artifactory. We have a bunch of compilers (a few Gigs) we want available via NFS, is this ...
3
votes
3answers
272 views

Accessing a AWS docker instance via localhost only?

Suppose I have two apps launched via the AWS ECS cluster (using Docker containers). I want to expose one app to the world via a public IP (and I do it via the AWS load balancer) but the other one I ...
3
votes
4answers
5k views

Is it possible to mount an s3 bucket as a point in a docker container?

I have a Java EE packaged as war file stored in an AWS s3 bucket. I will like to mount the folder containing the .war file as a point in my docker container. I have managed to do this on my local ...
3
votes
1answer
7k views

Using volumes on AWS fargate

I'm new to fargate and even dockers. But I have used dockers for a couple of months. Only now, I am using fargate. I create a particular docker instance as follows: docker run -v localHostFolder/...
3
votes
1answer
450 views

Blue/green deployment with micro services and DNS

Currently, we have on our test environment an ECS Cluster with micro services deployed. All micro services are talking to each other through Route53 DNS CNAMEs like service1.company.com, service2....
3
votes
1answer
2k views

Are AWS Boto3 calls asynchronous?

In the API documentation for Apache Cloud Stack for example, they put an (A) to designate asynchronous API calls. In the Boto3 - Python client API for AWS - documentation as I can't see anything like ...
3
votes
2answers
809 views

All volumes are deleted when EC2 intance is deleted via terraform

I am using a terraform template to create AWS resources. My count is 2, everything gets created as per plan, and, I am attaching a 2nd EBS volume of 1 GB to both machines, which is also happening well....
3
votes
2answers
1k views

List encrypted RDS snapshots using CLI

I have automated the RDS snapshot copy across the region, but the Snapshot which is encrypted gets fail to copy. I have figured a way to copy an encrypted snapshot using $ aws rds copy-db-snapshot ...
3
votes
1answer
71 views

K8s cluster in peered VPC can't reach RDS cluster

I have two K8s clusters in the same VPC that I want to connect to an MySQL Aurora RDS cluster. One of the clusters can reach the RDS cluster just fine. The other, however, cannot. I'll call these eks-...

1
2
3 4 5
9