Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

Filter by
Sorted by
Tagged with
1
vote
1answer
58 views

Docker image registries

We are using AWS EC2 container services and we are using Amazon container registry but the problem with container registry is that it's only available in one region although it's have URI but is ...
6
votes
2answers
167 views

AWS Spot instances price

While trying to create spot instances I notices that the Price for almost all instance types (from m3 , c3, c4) are always higher than the On-Demand price of corresponding variants in us-east-1c and ...
2
votes
1answer
70 views

terraform - how should I clone my code repo?

I have a very simple terraform configuration. I boot up an aws instance of Ubuntu trusty and assign a security group. My question is who is responsible of getting the latest code from my code repo? ...
4
votes
2answers
1k views

LambdaA -> delay mins -> lambdaB

I need to launch a LambdaA function and after X minutes I need to launch a LambdaB function with parameters passed from LamdaA I have testing the following: APIGW > LambdaA > SQS with delay > SQS ...
4
votes
1answer
809 views

How to provide multiple configs for EC2 node using Terraform and cloud-init?

I need to use several configs on my EC2 node using Terraform. data "template_cloudinit_config" "puppetserver_config" { gzip = true base64_encode = true part { ...
11
votes
1answer
2k views

How to support releasing new versions of the code, running in parallel with the last stable release?

I have one service in production (on AWS), which follows the immutable server pattern. Its deployment looks like this: Create a new AMI with Packer. Create a new CloudFormation stack, starting with ...
2
votes
1answer
2k views

Why does the datasource "external" always fail?

so my issue here is that terraform really does not like a command I'm trying to run using an external datasource. I'm trying to hack my way around a problem where terraform wont wait for a KMS ...
5
votes
1answer
2k views

How to send SMS through AWS?

Can we send SMS through AWS for the below case? I have an application installed on Ec2 and that application runs few rules and may send SMS to end users if the rule conditions are met. I wanted to ...
8
votes
5answers
6k views

How to provide a user to access only a particular bucket in AWS S3?

I have a list of buckets in AWS S3. I have created an IAM user. I have an option to provide S3 full or read only access for a user using groups. Is there any options to provide access only to a ...
6
votes
3answers
330 views

Continuously getting locked out from EC2 instance. No supported authentication methods available

I am getting continously locked out from my ec2 instance time and again. I have to take its root volume and attach it to some other instance (mostly new instance) to prevent data loss. I am not able ...
5
votes
1answer
137 views

Wordpress on AWS, how to update only a theme

In order to setup a flow from developer code to a public URL, I've been testing some flows and the current one does not work that good: I have an AWS Pipeline that picks up the source code from ...
13
votes
4answers
7k views

CodeBuild - multiple input artifacts in AWS Pipeline

I am building an AWS CodePipeline which depends on two source repositories. If the 'CodeBuild' step is specified with multiple Input artifacts, then you get the error: .. declares 2 input artifacts ...
4
votes
2answers
2k views

Jenkins configuration to support multi-config multi-branch CI

Here are my requirements and I go back-and-forth on how to achieve them: Must build Java spring-boot apps Artifacts must be released to artifactory repository Docker image to be built directly ...
5
votes
1answer
5k views

How do I write a buildspec.yml file?

I have Java Spring web service project on EC2 I tried writing a buildspec.yml for it. However the AWS CodeBuild service is not giving successful results. In the install phase itself, it tells apt-...
1
vote
1answer
1k views

Terraform: How to use a variable inside of another variable?

I'm trying to design it so that all configurable parameters exist within variables.tf...the issue I'm running into currently is for provisioning EC2 instances. I'd like to be able to define the ...
2
votes
1answer
3k views

Terraform - resource repeated multiple times

I have a terraform plan which consists of multiple aws_sqs_queue resources which more of less share the same config. Before I remove any repeating configs and use variables I wanted to run terraform ...
9
votes
2answers
3k views

Application calling AWS internal load balancer in same subnet is timing out

Some background: I've created a moderately complex network using Amazon's vpc. It's a three-tiered network across two availability zones. Each layer has a subnet in zone-a and zone-b. The ...
8
votes
1answer
136 views

Debug BackendConnectionErrors from Kubernetes Service LoadBalancer sesrvice

We recently moved some of our production infrastructure to Kubernetes. Many pods are exposed through a LoadBalancer service on AWS. This creates an ELB, registers each node in the cluster with the ELB,...
8
votes
1answer
8k views

How to get the ARN for an arbitrary Amazon Resource?

I am creating an AWS IAM policy for a Serverless Framework project, I am applying the Principle of Least Privilege to ensure the policy is as tight as possible. To restrict the scope of the policy I ...
10
votes
2answers
246 views

How to track changes to AWS settings?

Is there a way to track changes we make to the AWS system? For example, changes to a subnet setting, from using nat to iwg - these display a message, and then disappear. Is there a way to get AWS to ...
35
votes
5answers
9k views

How to avoid interactive dialogs when running "apt-get upgrade -y" in Ubuntu 16.04 when packaging with Packer?

I'm using Packer to create an AWS AMI based on an Ubuntu 16.04 image. In the beginning, I'm doing an upgrade: sudo apt-get update sudo apt-get upgrade -y Here is the relevant part of my provisioners ...
4
votes
1answer
74 views

Looking for ways to host application in AWS and have it monitored using opensource

I am a newbie in the world of DevOps and have been assigned a task to implement web applications for the customers in AWS and that application monitored (security, metrics and logging) using any of ...
7
votes
3answers
2k views

How to ensure equitable distribution of SQS messages in a distributed systems setting?

I have multiple servers, each having a script polling an SQS queue [all polling the same queue]. So, is there any way I can ensure an equitable distribution of messages to all those clients [i.e. my ...
22
votes
5answers
4k views

How can I experiment with Cloud (Azure, AWS, Google, etc) without going broke?

Cloud technologies are very hot right now, but they can be expensive. What are the best strategies for learning/trying cloud services without racking up a huge bill?
17
votes
3answers
2k views

How to check AWS spot pricing automatically?

I've been thinking about a Jenkins job to check the pricing for the agent boxes we spin up; every so often the price spikes and it'll be an hour or two before anyone notices that no new agents are ...
8
votes
1answer
3k views

How do I detach an existing volume and attach a new volume with Terraform?

Is there a way to detach EBS volume from existing EC2 instance and attach a new EBS volume using Terraform v0.9.2 ? I prefer to replace the volume rather than trying to destroy the instance and ...
17
votes
1answer
5k views

How to create a centralised dashboard to monitor multiple cloud (Amazon and Google)?

I'm looking for a single product or service which can be used as a centralized dashboard to monitor cloud infrastructure provide by Amazon Web Services and Google Cloud Platform in addition to the ...
7
votes
1answer
103 views

How to use tags in Amazon Web Services and Azure

I am currently building a solution on Azure (though the question should relate to AWS equally) and I am using a UniqueId tag to locate and use objects. For instance, we have a storage account that ...
33
votes
4answers
10k views

Why is the AWS EC2's spot price greater than the on-demand price?

I was trying to provision spot instances via Ansible yesterday, and almost all my requests failed, even when I put my spot price == the on-demand price of that instance. So, when I had a look at the ...
12
votes
3answers
10k views

How to backup Amazon Cognito?

Amazon Cognito is a user management and authentication service provided by Amazon through Amazon Web Services: Amazon Cognito lets you easily add user sign-up and sign-in to your mobile and web ...
5
votes
1answer
1k views

How to implement blue-green deployment with one master branch

I was told that they easy way out is to have two production branches, master/blue and master/green, git merge action triggers CI to deploy to the matching stacks. Is that possible to do it with single ...
1
vote
1answer
526 views

Is it possible to host an ECS cluster with p2 or other GPU instance types?

It seems from the GUI that it is not possible (the GPU instance types are simply not listed when you go to create an ECS cluster and look at the list of instance types). However, there is an official ...
7
votes
1answer
2k views

How can I autoscale instances based on Kafka topic lag?

I have autoscaling groups that I want to dynamically scale up/down based on the amount of lag showing in certain Kafka topics. There's a 1:1 relationship between topic and autoscaling group that needs ...
11
votes
1answer
2k views

How to automatically remove a dead node from RabbitMQ cluster

I am planning to create RabbitMQ cluster using Ansible on AWS VPC with Amazon internal load balancer as the frontend to point connections to it. Any suggestion how to remove a dead node from RabbitMQ ...
27
votes
5answers
9k views

How to clean up orphaned AWS EC2 snapshots?

We end up with a fair amount of AWS EC2 snapshots where the AMI has been deleted, but the snapshot is left behind to rot. I'd like a non-manual way of identifying and deleting these orphans to save us ...
7
votes
1answer
226 views

How to automate submission to Amazon Marketplace?

Is anyone aware of a way to automate the submission of an AMI to Amazon's Marketplace? I want to take a public AMI and share it to the AWS Marketplace so it can be scanned for listing and then submit ...
11
votes
1answer
929 views

How to set up AWS Trusted Advisor alert for Service Limit warnings?

All I want in life is for AWS to shoot me an email when any of Trusted Advisor's Service Limits go to WARN or ERROR status. I've checked their guides, tried chatting with support and no one can get ...
33
votes
3answers
4k views

Who is this Chaos Monkey and why did he crash my server?

I had a perfect server, it was so pretty and rock solid and so I named it Petra. It was perfect in every way, everything was configured and tuned just right, it had perfect 100% service record and 753 ...
7
votes
5answers
254 views

What are best practices and/or tools for updating AMIs on a regular basis?

I have a Master-Workers style computation model. And, I launch the workers via an AMI through an Ansible playbook. The workers' AMI has all the necessary configs needed for doing the computation (...
13
votes
1answer
2k views

How to communicate queue-based processing delays to non-technical team members?

I am responsible for a set of SQS queue-processing jobs with a scaling policy on the ApproximateNumberOfMessagesVisible CloudWatch metric. These jobs can fail to keep up with the amount of messages ...
11
votes
1answer
737 views

Is Elastic Beanstalk suitable for enterprise-grade CD?

I'm working with a project that's using Jenkins to build and deploy microservices to Elastic Beanstalk. We deploy an integration branch to a test environment, release branches to a staging environment,...
7
votes
2answers
9k views

How to only allow API Gateway requests to reach our EC2 instances

We have multiple EC2 instances hosting our micro-services. The autoscaling group of servers has an ELB. All traffic is routed via the AWS API Gateway. The problem is that the ELB has its HTTPS port ...
14
votes
1answer
669 views

How do you manage your inventory of spot instances on AWS with Ansible

I am new to Ansible, with some experience in Chef. I am considering learn and use Ansible to manage environments. I was wondering, what would be the best practice to manage inventory of AWS spot ...
20
votes
2answers
7k views

Is it possible to set CloudWatch alarm for a combination of metrics?

For example, I want to trigger a CloudWatch alarm for the following: Number of messages sent - Number of messages deleted >= 6 The above is for AWS SQS metrics. And I want that metric to trigger AWS ...
9
votes
1answer
631 views

How can I manage changes in desired capacity due to scaling policies in AutoScaling Group state?

How can I manage changes in desired capacity due to scaling policies in AutoScaling Group state in terraform? Specifically, suppose I provision an aws_autoscaling_group resource with terraform with a ...
22
votes
1answer
510 views

How do I work around the fact that AWS SQS is not HIPAA compliant?

I have a use case where data from S3 is queued into AWS SQS, which is in turn connected to CloudWatch, whose metrics will be triggering AWS Lambda. However, I want the architecture to be HIPAA ...
34
votes
2answers
636 views

What is a good strategy to keep my site online when S3 goes offline?

What is a good strategy to keep my site online when S3 goes offline? If S3 US East 1 goes offline, how should I have my app configured/structured to prevent that taking my entire site offline? What ...
3
votes
1answer
265 views

Is it possible to package an application in a .nupkg when creating an application revision in AWS CodeDeploy?

My build process packages my application in a .nupkg instead of a .zip. Assuming my .nupkg contains a correctly-implemented appspec.yml and is otherwise appropriately bundled, can my deployment ...
17
votes
2answers
405 views

How to order physical backup of S3 data?

I'd like to order backup of data to be copied out from S3 to a physical drive (SATA HD) and to be shipped to the address. I know it's possible using Amazon Glacier, however I cannot find such option ...

1
5 6 7 8
9