39
votes
Accepted
Who is this Chaos Monkey and why did he crash my server?
TL;DR: Chaos Monkey was developed in 2010 at Netflix and released into wild in 2012 is part of the Simian Army, wildly popular among devoted followers. Built on principles of chaos engineering, the ...
- 5,837
31
votes
Accepted
Why is the AWS EC2's spot price greater than the on-demand price?
This is actually a great example of people slightly abusing spot. People are saying 'Our workload is really important but we don't want to pay full on demand price', so they set a bid price higher ...
- 516
29
votes
Accepted
What is a good strategy to keep my site online when S3 goes offline?
In March 2015, Amazon AWS announced they support S3 replication across regions. When a certain region in S3 goes offline, you can serve files from your mirror in another region.
source: https://aws....
- 9,003
26
votes
Accepted
How to avoid interactive dialogs when running "apt-get upgrade -y" in Ubuntu 16.04 when packaging with Packer?
This sequence of commands works for me:
apt-get update
DEBIAN_FRONTEND=noninteractive apt-get upgrade -yq
So, DEBIAN_FRONTEND=noninteractive is correct but you also need the -q flag.
Source: https:/...
- 1,675
20
votes
Accepted
How can I experiment with Cloud (Azure, AWS, Google, etc) without going broke?
The three major cloud platforms you mentioned have either free trials or a free tier; these all include spending and resource caps which prevent you from spending more than your free trial allows:
...
- 11.7k
19
votes
Accepted
How do I work around the fact that AWS SQS is not HIPAA compliant?
According to Amazon AWS
Customers may use any AWS service in an account designated as a HIPAA
account, but they should only process, store and transmit PHI in the
HIPAA-eligible services ...
- 9,003
19
votes
Accepted
How to support releasing new versions of the code, running in parallel with the last stable release?
There are a few different ways to achieve goals of this sort, each with some different tradeoffs. I'm going to describe the most common ones below.
The simplest approach is to use Terraform's ...
- 2,279
16
votes
Accepted
How to clean up orphaned AWS EC2 snapshots?
Largely inspired by the blog posts and gist already linked in the other answers, here is my take to the problem.
I did use some convoluted JMESpath functions to get a list of snapshots and not ...
- 11.4k
16
votes
Accepted
How to communicate queue-based processing delays to non-technical team members?
As with any outage communications, a non-technical reader will be primarily looking to understand:
How long was it?
How bad was it?
Amazon CloudWatch metrics provides the following metrics for SQS ...
- 1,494
16
votes
Accepted
What is the purpose of AssumeRolePolicyDocument in IAM?
The purpose of the AssumeRolePolicyDocument is to contain the trust relationship policy that grants an entity permission to assume the role.
In your example it's granting the Lambda service the ...
- 670
15
votes
Accepted
How do you manage your inventory of spot instances on AWS with Ansible
You are looking for Dynamic Inventory
Please look into ec2.py and ec2.ini of Ansible, and also the Dynamic Inventory docs of Ansible are very good for understanding how to manage your AWS inventory.
- 2,816
15
votes
How to check AWS spot pricing automatically?
Spotted an open source tool called autospotting that just might help with this:
Once enabled on an existing on-demand AutoScaling group, it launches an EC2 spot instance that is cheaper, at least ...
- 441
15
votes
Accepted
Should AWS arn values be treated as secrets?
Well, from a security point of view, it's never bad to give people less information.
But, as long as you have sensible security policies in AWS, there is no reason that an arn has to be considered ...
- 1,550
14
votes
Accepted
How to create a centralised dashboard to monitor multiple cloud (Amazon and Google)?
I think what you are looking for is an Open Source project that can take inputs from both Amazon CloudWatch and Google StackDriver; there isn't a huge amount out there at the moment, but I will detail ...
- 11.7k
14
votes
How can I experiment with Cloud (Azure, AWS, Google, etc) without going broke?
Emulate the cloud on your own hardware
Doing anything substantial with the free tier is challenging. But you probably have some hardware lying around that you can build your own minicloud on. If you ...
- 1,893
13
votes
Why is the AWS EC2's spot price greater than the on-demand price?
There are 2 reasons for this:
A lot of users are using the spot instance at some times (Think about batch processing, boot up 100 machines as spot instance and crunch away).
For a spot instance you ...
- 131
13
votes
How to avoid interactive dialogs when running "apt-get upgrade -y" in Ubuntu 16.04 when packaging with Packer?
Your problem is that grub file change adhere to ucf and not debconf, as per this incident on apt list you're not alone.
As workaround I found this answer on askunbuntu. Removing the menu.lst from the ...
- 11.4k
13
votes
What is the purpose of AssumeRolePolicyDocument in IAM?
For anyone who is scratching their head at the naming convention:
AssumeRolePolicyDocument (in CloudFormation yaml) = Trust Relationships (in AWS Console web GUI)
Policies (in CloudFormation yaml) = ...
- 231
12
votes
Accepted
How to order physical backup of S3 data?
AWS Import/Export is a service that accelerates transferring data into and out of AWS using physical storage appliances, bypassing the Internet. AWS Import/Export Disk was originally the only service ...
- 9,003
12
votes
Accepted
How to backup Amazon Cognito?
The Amazon Cognito streams feature can be used to backup data.
Currently, Amazon does not provide a solution to backup their Cognito user Pools. You can use the following NPM package called "cognito-...
- 1,172
12
votes
How to track changes to AWS settings?
AWS has the CloudTrail service that tracks most of the API calls done in your account. Then stores these in files in your specified S3 bucket.
https://aws.amazon.com/cloudtrail/
Using CloudTrail ...
- 9,003
11
votes
What is a good strategy to keep my site online when S3 goes offline?
What you are asking for is, basically, high-availability. In order to make a system highly available, you need three things:
Eliminate single points of failure
A mechanism to switch from an endpoint ...
- 1,965
11
votes
Jenkins installed on aws unable to launch on browser
It seems your have not opened your 8080 port in Security Groups in AWS.
Steps:
Go to AWS console
Click Security Group and select the security group that you have assigned to your EC2 instance.
Click ...
- 211
10
votes
Accepted
How can I manage changes in desired capacity due to scaling policies in AutoScaling Group state?
The desired_capacity in Terraform is marked in the documentation as optional. So with a proper min_size value, Terraform can wait until the minimum capacity is reached before continuing.
The above, ...
- 9,003
10
votes
Accepted
How do I detach an existing volume and attach a new volume with Terraform?
The old volume is never detached because skip_destroy = true. From the terraform docs:
skip_destroy - (Optional, Boolean) Set this to true if you do not wish to detach the volume from the instance ...
- 216
10
votes
Accepted
How to provide a user to access only a particular bucket in AWS S3?
Amazon's IAM roles generally grant a role access to a particular ARN (Amazon Resource Name). Amazon notes on their pages that for S3 a resource
...can be a bucket-name or a bucket-name/object-key.
...
- 3,742
10
votes
What is the purpose of AssumeRolePolicyDocument in IAM?
The purpose of assume role policy document is to grants an IAM entity permission to assume a role. It is also known as a "role trust policy".
In other words, for given permissions you set, it allow ...
- 7,981
10
votes
Accepted
Running a command as a specific user on an ec2 using ssm
I didn't find anything on AWS or boto3 docs that allows for that, but I was able to execute as a different user using the runuser command. In theory, you could do the same thing with a combination of ...
- 216
10
votes
Who should write Docker files?
Isn't DevOps .. you know .. Devs and Ops working together, ideally in the same team?
What you refer to as Dev-ops in your post sounds very much like the traditional Operations - developers build ...
- 1,011
9
votes
Is it possible to set CloudWatch alarm for a combination of metrics?
Recently AWS just announced CloudWatch Metric Math which should be suitable for your use case.
References:-
Amazon CloudWatch Adds Metric Math to Enable Custom Operations on Metrics
Create a ...
- 191
Only top scored, non community-wiki answers of a minimum length are eligible