Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

Filter by
Sorted by
Tagged with
1
vote
0answers
154 views

How to integrate CI with federated AWS IAM roles? [closed]

Imagine a multi tenant environment using a CI (e.g. GitLab but can be any other) and AWS as a backend for test infrastructure. With fixed users, it is easy: save credentials as secrets. But what if ...
2
votes
2answers
1k views

ECS auto deploy with ECR

I'm using github, jenkins, aws ECR, aws ECS. I want to deploy automatically when github have new commit. When github have new commit, github sends a event webhook to jenkins, jenkins builds the ...
1
vote
1answer
127 views

AWS Cloudformation: Callback only for CREATE_COMPLETE or CREATE_FAILED of entire stack

I am creating a CF stack; I have been using the --notification-arns flag of aws cloudformaction create-stack to send notifications to an email topic; however this produces a huge amount of spam, ...
0
votes
1answer
55 views

AWS: Using CloudFront as CDN for non-AWS hosted content

Is there a way (say by providing a Route53 endpoint as origin) to distribute non-AWS hosted content using CloudFront? (assuming the Route53 is used as dns for a site hosted outside of amazon)
2
votes
1answer
408 views

Storing my Lambda Functions on GitHub

Will it be practically possible to build some pipeline; starting from rapid AWS Lambda function development using blueprints, to store them later on a new GitHub repo, that is linked to some CICD ...
1
vote
1answer
167 views

Rancher, Load Balancing and own domain

I have a question about rancher. I'm running my rancher on aws. I have created a new cluster with two nodes (workers) and I have deployed my docker images. Now I wanted to add Load Balancer, but I don'...
1
vote
1answer
29 views

Is there an established metric to describe optimal/needed ressources for a specific computational task?

Let's say I have a piece of software which does a computational task that is pretty demanding to either CPU/GPU/RAM/Disk-IO or a combination of those. Then it would be optimal if one has some metric ...
0
votes
1answer
68 views

Communication between VPCs and a transit VPC hosting VPN Server without Masking source IP

I am setting up a VPN Server to move all resources behind VPN on AWS, which includes moving multiple VPCs. The simple setup is: I have a separate VPC (VPC1) running VPN Server and another VPC (VPC2) ...
1
vote
1answer
223 views

Amazon EKS: using spot instances for worker nodes

When using AWS EKS, is it possible to set up the worker nodes on spot instances? how? Anything I special I should pay attention to, in such a setup?
0
votes
2answers
145 views

Understanding and tweaking AWS policies for job functions

There are quite many possibilities to configure AWS policies; Amazon has therefore provided policies for job functions. Now is it anyhow possible to sneak into JSON code of these policies to learn in ...
0
votes
1answer
88 views

How do I handle multiple AWS accounts in Terraform?

I've read up on Terraform and using AWS S3 and DynamoDB for sharing state and locking. My problem is that we have multiple AWS accounts, by which I mean multiple sign-in locations like: https://...
1
vote
1answer
69 views

Where to state CFT dependencies

With AWS, why can't I just state in the cloudformation template which dependencies I need? Right now I need to add the dependencies automatically in an accompanying script during our gitlab pipeline. ...
5
votes
3answers
2k views

How to monitor AWS S3 cross-region replication process?

Amazon S3 has a cross-region replication which will handle copy of new/updated objects to additional region. The problem is that solution does not provide visibility on state for replication process, ...
6
votes
1answer
3k views

How can I use a local file for a nested Cloudformation stack?

How and is it possible to use a local file for a CloudFormation stack besides an S3 bucket?
29
votes
4answers
22k views

What is the purpose of AssumeRolePolicyDocument in IAM?

I'm confused as to what the purpose of AssumeRolePolicyDocument is. It seems like to create a role all you need is a parent name that you can attach policies to. It seems like AssumeRolePolicyDocument ...
3
votes
1answer
5k views

How to "inject" AWS Lambda code into a CloudFormation?

I'm exercising an idea of not using S3 bucket to refer to the code of a lambda function. The usual example of a lambda CloudFormation code might look like: MyLambda: Type: AWS::Lambda::...
7
votes
2answers
680 views

Best way to launch 100 identical Docker machines on AWS?

I need to do some large scale testing on a system. The system consists of 2 main parts: Manager and Nodes. There will be only one manager server, but 100 nodes. Both the manager and nodes are Docker ...
1
vote
2answers
3k views

Always execute post statement in a jenkins pipeline when a conditional statement is met

Although it seems counterintuitive, I would like to execute an always statement when a conditional is met. In my pipeline, my post statement should always destroy my AWS CloudFormation Stack if a ...
3
votes
1answer
65 views

AWS CLI --profile with duration > 1h

With the AWS CLI you can assume a role using the --profile parameter: aws --profile <profile_name> <service> <command> e.g.: aws --profile admin s3 ls s3://mybucket/ That profile ...
3
votes
0answers
739 views

Can I restart a container within an ECS task group without restarting the entire task? [closed]

I know this isn't possible through the AWS portal, but we have a scenario where we would like to restart a container that may have died, which isn't essential. The scenario is along the lines of ...
4
votes
4answers
234 views

DevOps tools and automation of manual processes

This is a general question, but couldn't find a better place to ask. I'm a new DevOps member in a company, and I've been ask to "update" our DevOps technologies. Generally speaking, in what areas do ...
2
votes
1answer
34 views

Do AWS backups of large empty volumes take longer than small ones?

AWS provides backup functionality for RDS databases and snapshots functionality for EBS volumes. Given a small amount of data, would the backup and restore time change depending on whether it's ...
3
votes
1answer
481 views

Blue/green deployment with micro services and DNS

Currently, we have on our test environment an ECS Cluster with micro services deployed. All micro services are talking to each other through Route53 DNS CNAMEs like service1.company.com, service2....
4
votes
2answers
5k views

Placing an AWS Lambda in a public subnet

Is it possible to place an aws lambda in a public subnet and thus avoid paying for NAT? The docs state the following If your Lambda function needs Internet access, do not attach it to a public ...
-1
votes
1answer
62 views

AWS: Fargate charging model

According to Amazon's official documentation, For Amazon ECS, AWS Fargate pricing is calculated based on the vCPU and memory resources used from the time you start to download your container ...
7
votes
1answer
1k views

AWS ECS/EKS: EC2 vs Fargate mode

Amazon offers the option of launching their container management services ECS and EKS in two modes: EC2 and Fargate. In the former, normal VMs (EC2 instances) are used and ECS or EKS (depending on ...
1
vote
1answer
2k views

Different download speeds from AWS S3 CLI vs Console/Websites

I'm experiencing much slower traffic for the exact same files when downloading (or uploading) them via the AWS website vs. downloading them via the CLI. Is there a known reason for this? Is there ...
1
vote
0answers
31 views

Converting s3 URL to the desired one [closed]

I have created a s3 bucket with all permissions and user access through IAM policies. I give the below URL to the customer to access that bucket https://s3.console.aws.amazon.com/s3/buckets/s3-upload-...
3
votes
1answer
388 views

Configure AWS cli inside chef cookbook

I am working on setting up something with S3 and Chef, I have AWS CLI installed and working but I need to figure out how to specify the access ID and the secret access key. I know there are cookbooks ...
4
votes
2answers
89 views

AWS or Azure with usage auto shutdown occasional usage

I'm looking for recommendations on which cloud service provider we should be looking at. The situation: I'm part of a small team looking to leverage more powerful analytics. Most of our day to day ...
3
votes
2answers
58 views

Are Route 53 DNS records aliasing ELBs guaranteed for their lifetime?

Given a Route 53 DNS record aliasing a (classic) load balancer, and the potential for the load balancer ip to change: Is it possible for the DNS record to guarantee that the provided ips are valid ...
1
vote
1answer
56 views

AWS Security Group Creation Using AWS CLI

I have created a security group in AWS. I have added the ingress rule using the below command aws ec2 authorize-security-group-ingress --group-id sg-07xxxx4d --ip-protocol tcp --from-port 22 --to-...
4
votes
3answers
1k views

Amazon EKS from local kubectl does not cache MFA token/session

I have set up an EKS cluster in AWS. My user-account there is secured with MFA. And I have an assumerole, that is allowed to manage my infrastructure. So I installed and configured my system as ...
2
votes
1answer
423 views

How do I configure an AWS network load balancer with an A record in Cloudflare

I am trying to use an AWS Network Load Balancer to point at a group of servers. I would then like to take my DNS and point it at the load balancer. However, after I set everything up I cannot find and ...
3
votes
1answer
75 views

Is running load balanced autoscale apps cheaper on AWS Kubernetes than just using EC2 resources?

We're running like 100+ servers on AWS EC2 with like 20 microservices all load balanced and autoscaled with 2 to 3 instances. The cost has become....very significant. I'm wondering if migrating ...
2
votes
1answer
29 views

I have an custom AMI and want to run certain config commands at initial boot, depending on the autoscale instance that starts it. How do I do this?

I have a custom AMI that contains the dependencies for several applications. The only difference between the applications is several configuration options that can be configured by a bash script. (i....
3
votes
1answer
435 views

AWS: Application vs Classic Load Balancer

My senario is this: I am using 2 EC2 instances which I want reachable via urls as follows: sub1.domain.com sub2.domain.com I am aware of the fact that AWS Application Load Balancers currently ...
-2
votes
2answers
228 views

Why does amazon charge for free tier usage?

I have an issue with amazon free tier account, I have deployed two EC2 instances (1 linux and 1 windows) on amazon each having 30GB of storage which is permissible under free tier, these instances are ...
1
vote
1answer
173 views

How to create AWS application load balancer using saltstack

I was trying to create application load balancer with salt stack. I am using salt boto_elbv2 which is having option to create target groups but dont have option to create load balancer, how can i ...
2
votes
1answer
50 views

Bad practice having a single SSH gateway with access to all environments?

I have started at a new company and am in the process of locking down SSH access to be through a single SSH gateway server. My question is, should I create a separate SSH gateway server for each ...
0
votes
1answer
48 views

Processing message queues quickly without wasting money on AWS Lambda

What are some strategies and patterns for processing message queues quickly? I have a Lambda function that is invoked on a schedule every x minutes to process a number of messages in the queue. I ...
2
votes
2answers
817 views

What's the best complete DevOps setup?

I'm curious what everyone recommends. Vagrant is for setting up test environments right? Ansible/Chef etc. seem good for servers you own, but what about cloud? Docker... great for standardizing app, ...
8
votes
0answers
876 views

Provisioning times for Redis in cloud taking too long, how can we shorten it?

Provisioning a 1 GB Redis cache service on AWS takes around 8 minutes. Doing the same on Azure takes around 16 minutes. Ours Terraform scripts need the call back from the Redis systems. Why is this ...
0
votes
1answer
20 views

What tools should I deploy to support AWS for a Managed Services company?

I work for a managed services company and am working out a plan to retrofit our customer support machines to support AWS in a general way. We use Ansible and lots of ssh port forwarding to connect ...
4
votes
1answer
67 views

Trade offs of putting an international master database in us-west-2

I'm hoping this isn't so open ended that it veers towards a "discussion" more than an "answerable" question. I need to place an RDS Postgres instance in an AWS region that will act as the master DB ...
-2
votes
1answer
35 views

Python Dictionary [closed]

I am getting the output from my previous executions something like this: [{u'Value': '2018-06-21', u'Key': 'Deletion_Date'}] I want to get only 2018-06-21 saved in a variable. I tried this ...
5
votes
2answers
2k views

Monitor Jenkins node/slave health

For a project I'm working on, we need to create a Jenkins node in an AWS environment. For this task, we will work with the docker image, which is available on https://github.com/jenkinsci/docker-ssh-...
6
votes
3answers
987 views

Terraform AWS AZ error - manually specify AZ?

I'm fairly new to terraform and when creating AWS infrastructure I use the following to fetch the 'available' availability zones for my region (us-east-1) where I'm trying to create an EKS cluster. ...
3
votes
2answers
8k views

How can I simulate failure of an AWS Availability Zone?

In order to test that our load balancers and Multi-AZ RDS instances are working the way I'd expect them to, I'd like to simulate failure of an AWS Availability Zone. Short of locating one of the ...
2
votes
1answer
1k views

Terraform Issue - Can't find Data Source in Sub Module?

I'm fairly new to Terraform and have been following this example on creating an EKS cluster - https://github.com/terraform-providers/terraform-provider-aws/tree/master/examples/eks-getting-started ...

1
6
7
8 9 10