Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

0
votes
0answers
6 views

Amazon EKS: using spot instances for worker nodes

When using AWS EKS, is it possible to set up the worker nodes on spot instances? how? Anything I special I should pay attention to, in such a setup?
0
votes
2answers
17 views

Understanding and tweaking AWS policies for job functions

There are quite many possibilities to configure AWS policies; Amazon has therefore provided policies for job functions. Now is it anyhow possible to sneak into JSON code of these policies to learn in ...
0
votes
0answers
11 views

Managing IAM policies with Terraform to implement CRUD of AWS resources

Recently I have discovered this feature request for Terraform to support advanced management of AWS IAM policies, specifically to implement the CRUD (Create, Read, Update, Delete) method. In the ...
0
votes
1answer
40 views

How do I handle multiple AWS accounts in Terraform?

I've read up on Terraform and using AWS S3 and DynamoDB for sharing state and locking. My problem is that we have multiple AWS accounts, by which I mean multiple sign-in locations like: https://...
1
vote
1answer
16 views

Where to state CFT dependencies

With AWS, why can't I just state in the cloudformation template which dependencies I need? Right now I need to add the dependencies automatically in an accompanying script during our gitlab pipeline. ...
3
votes
0answers
36 views

How to monitor AWS S3 cross-region replication process?

Amazon S3 has a cross-region replication which will handle copy of new/updated objects to additional region. The problem is that solution does not provide visibility on state for replication process, ...
1
vote
1answer
14 views

How can I use a local file for a nested Cloudformation stack?

How and is it possible to use a local file for a CloudFormation stack besides an S3 bucket?
1
vote
1answer
41 views

What is the purpose of AssumeRolePolicyDocument in IAM?

I'm confused as to what the purpose of AssumeRolePolicyDocument is. It seems like to create a role all you need is a parent name that you can attach policies to. It seems like AssumeRolePolicyDocument ...
2
votes
1answer
26 views

How to “inject” AWS Lambda code into a CloudFormation?

I'm exercising an idea of not using S3 bucket to refer to the code of a lambda function. The usual example of a lambda CloudFormation code might look like: MyLambda: Type: AWS::Lambda::...
6
votes
1answer
72 views

Best way to launch 100 identical Docker machines on AWS?

I need to do some large scale testing on a system. The system consists of 2 main parts: Manager and Nodes. There will be only one manager server, but 100 nodes. Both the manager and nodes are Docker ...
1
vote
1answer
17 views

Always execute post statement in a jenkins pipeline when a conditional statement is met

Although it seems counterintuitive, I would like to execute an always statement when a conditional is met. In my pipeline, my post statement should always destroy my AWS CloudFormation Stack if a ...
2
votes
1answer
20 views

AWS CLI --profile with duration > 1h

With the AWS CLI you can assume a role using the --profile parameter: aws --profile <profile_name> <service> <command> e.g.: aws --profile admin s3 ls s3://mybucket/ That profile ...
0
votes
0answers
6 views

Can I restart a container within an ECS task group without restarting the entire task?

I know this isn't possible through the AWS portal, but we have a scenario where we would like to restart a container that may have died, which isn't essential. The scenario is along the lines of ...
3
votes
3answers
152 views

DevOps tools and automation of manual processes

This is a general question, but couldn't find a better place to ask. I'm a new DevOps member in a company, and I've been ask to "update" our DevOps technologies. Generally speaking, in what areas do ...
2
votes
1answer
31 views

Do AWS backups of large empty volumes take longer than small ones?

AWS provides backup functionality for RDS databases and snapshots functionality for EBS volumes. Given a small amount of data, would the backup and restore time change depending on whether it's ...
3
votes
1answer
39 views

Blue/green deployment with micro services and DNS

Currently, we have on our test environment an ECS Cluster with micro services deployed. All micro services are talking to each other through Route53 DNS CNAMEs like service1.company.com, service2....
0
votes
0answers
20 views

AWS ElasticBeanstalk Clone Prod to a temporary environment to debug

Is there a good approach to create a copy of prod environment just for devs to debug a bug that couldn't be reproduced or is there any appropriate setup in multi-tenant situation with multiple ...
0
votes
1answer
31 views

Placing an AWS Lambda in a public subnet

Is it possible to place an aws lambda in a public subnet and thus avoid paying for NAT? The docs state the following If your Lambda function needs Internet access, do not attach it to a public ...
0
votes
0answers
22 views

Managing Cloud Formation Templates in SCM and S3 Buckets

I have multiple projects with a CFT stored in Git. However, these CFT files are too large (exceed Amazon's 51k byte limit) and have to be stored in S3. What is an effective method that would allow ...
0
votes
0answers
7 views

AWS ECS: Create the equivalent of kubernetes' ExternalService

I want to set up a microservices-based application on ECS. One of these is a mysql which so far has been a container with volumes for persistence; For several reasons we want to switch to RDS for ...
0
votes
1answer
24 views

AWS: Fargate charging model

According to Amazon's official documentation, For Amazon ECS, AWS Fargate pricing is calculated based on the vCPU and memory resources used from the time you start to download your container ...
2
votes
1answer
55 views

AWS ECS/EKS: EC2 vs Fargate mode

Amazon offers the option of launching their container management services ECS and EKS in two modes: EC2 and Fargate. In the former, normal VMs (EC2 instances) are used and ECS or EKS (depending on ...
0
votes
0answers
31 views

Terraform Project Organization with AWS VPC Peering Connections

How best does one organize a project for AWS that makes use of peering connections. At present my folder structure looks like this modules/ staging/ production/ provisioning/ peering/ I'm also ...
0
votes
0answers
65 views

ECS task fails to start when deploying Docker multi container App in Elastic beanstalk

I have a beanstalk application environment that use multi container docker instances.I have also pushed an image(simple app running a simple node js) to my ECR repository.But whenever i try to ...
0
votes
0answers
19 views

copy task definition in aws ecs

Is there a way to copy ECS Task definitions cross region? I know that there isn't any in the console, and I'm familiar with aws ecs describe-task-definition --task-definition in the CLI. Can I just ...
1
vote
1answer
80 views

Different download speeds from AWS S3 CLI vs Console/Websites

I'm experiencing much slower traffic for the exact same files when downloading (or uploading) them via the AWS website vs. downloading them via the CLI. Is there a known reason for this? Is there ...
0
votes
0answers
9 views

Is it possible to indirectly point to name servers during DNS resolution?

Currently a domain, xyz.com is registered on Gandi. It points to a Route53 hosted zone in AWS Account A. Would it be possible to make yet another hop, this time to AWS Account B? Gandi -> AWS Account ...
0
votes
0answers
14 views

Converting s3 URL to the desired one

I have created a s3 bucket with all permissions and user access through IAM policies. I give the below URL to the customer to access that bucket https://s3.console.aws.amazon.com/s3/buckets/s3-upload-...
2
votes
1answer
38 views

Configure AWS cli inside chef cookbook

I am working on setting up something with S3 and Chef, I have AWS CLI installed and working but I need to figure out how to specify the access ID and the secret access key. I know there are cookbooks ...
2
votes
1answer
27 views

AWS or Azure with usage auto shutdown occasional usage

I'm looking for recommendations on which cloud service provider we should be looking at. The situation: I'm part of a small team looking to leverage more powerful analytics. Most of our day to day ...
3
votes
2answers
46 views

Are Route 53 DNS records aliasing ELBs guaranteed for their lifetime?

Given a Route 53 DNS record aliasing a (classic) load balancer, and the potential for the load balancer ip to change: Is it possible for the DNS record to guarantee that the provided ips are valid ...
1
vote
1answer
27 views

AWS Security Group Creation Using AWS CLI

I have created a security group in AWS. I have added the ingress rule using the below command aws ec2 authorize-security-group-ingress --group-id sg-07xxxx4d --ip-protocol tcp --from-port 22 --to-...
0
votes
0answers
17 views

Deploying to Lambda via a cloud formation script and cannot access assets

I'm currently deploying a very basic NodeJS Lambda function to AWS using the Serverless framework. I need to access a chrome dependency which is located inside a /lib directory. I access it with ...
3
votes
2answers
163 views

Amazon EKS from local kubectl does not cache MFA token/session

I have set up an EKS cluster in AWS. My user-account there is secured with MFA. And I have an assumerole, that is allowed to manage my infrastructure. So I installed and configured my system as ...
1
vote
1answer
31 views

How do I configure an AWS network load balancer with an A record in Cloudflare

I am trying to use an AWS Network Load Balancer to point at a group of servers. I would then like to take my DNS and point it at the load balancer. However, after I set everything up I cannot find and ...
2
votes
1answer
47 views

Is running load balanced autoscale apps cheaper on AWS Kubernetes than just using EC2 resources?

We're running like 100+ servers on AWS EC2 with like 20 microservices all load balanced and autoscaled with 2 to 3 instances. The cost has become....very significant. I'm wondering if migrating ...
1
vote
1answer
15 views

I have an custom AMI and want to run certain config commands at initial boot, depending on the autoscale instance that starts it. How do I do this?

I have a custom AMI that contains the dependencies for several applications. The only difference between the applications is several configuration options that can be configured by a bash script. (i....
3
votes
1answer
41 views

AWS: Application vs Classic Load Balancer

My senario is this: I am using 2 EC2 instances which I want reachable via urls as follows: sub1.domain.com sub2.domain.com I am aware of the fact that AWS Application Load Balancers currently ...
-2
votes
2answers
47 views

Why does amazon charge for free tier usage?

I have an issue with amazon free tier account, I have deployed two EC2 instances (1 linux and 1 windows) on amazon each having 30GB of storage which is permissible under free tier, these instances are ...
0
votes
0answers
24 views

ACM SSL certificate with Elastic Beanstalk

We switched from Comodo wild-card SSL CA to a free version from AWS through the Certificate Manager. The domain is registered on Namecheap and the only way we could get the website to route traffic ...
1
vote
1answer
29 views

How to create AWS application load balancer using saltstack

I was trying to create application load balancer with salt stack. I am using salt boto_elbv2 which is having option to create target groups but dont have option to create load balancer, how can i ...
2
votes
1answer
45 views

Bad practice having a single SSH gateway with access to all environments?

I have started at a new company and am in the process of locking down SSH access to be through a single SSH gateway server. My question is, should I create a separate SSH gateway server for each ...
0
votes
1answer
39 views

Processing message queues quickly without wasting money on AWS Lambda

What are some strategies and patterns for processing message queues quickly? I have a Lambda function that is invoked on a schedule every x minutes to process a number of messages in the queue. I ...
2
votes
2answers
182 views

What's the best complete DevOps setup?

I'm curious what everyone recommends. Vagrant is for setting up test environments right? Ansible/Chef etc. seem good for servers you own, but what about cloud? Docker... great for standardizing app, ...
1
vote
0answers
45 views

Provisioning times for Redis in cloud taking too long, how can we shorten it?

Provisioning a 1 GB Redis cache service on AWS takes around 8 minutes. Doing the same on Azure takes around 16 minutes. Ours Terraform scripts need the call back from the Redis systems. Why is this ...
0
votes
1answer
15 views

What tools should I deploy to support AWS for a Managed Services company?

I work for a managed services company and am working out a plan to retrofit our customer support machines to support AWS in a general way. We use Ansible and lots of ssh port forwarding to connect ...
3
votes
0answers
30 views

Trade offs of putting an international master database in us-west-2

I'm hoping this isn't so open ended that it veers towards a "discussion" more than an "answerable" question. I need to place an RDS Postgres instance in an AWS region that will act as the master DB ...
-1
votes
1answer
21 views

Python Dictionary [closed]

I am getting the output from my previous executions something like this: [{u'Value': '2018-06-21', u'Key': 'Deletion_Date'}] I want to get only 2018-06-21 saved in a variable. I tried this ...
0
votes
0answers
15 views

Saving core dumps when AWS restarts a docker container

I have a Java Spring application running in a Docker container on AWS. When the Spring process is dead, the AWS is configured to automatically restart the Dockercontainer. This deletes any heap dump ...
1
vote
0answers
65 views

Monitor Jenkins node/slave health

For a project i'm working on we need to create a Jenkins node in an AWS environment. For this we will work with the docker image which is available on https://github.com/jenkinsci/docker-ssh-slave ...