Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

0
votes
0answers
8 views

multicloud connect over VPN?

I need to have a private connection between aws ec2 and Azure VM. 2 instances should communicate over private IP. I followed this Doc to create VPN but couldn't able to create IPsec tunnel ...
1
vote
0answers
8 views

How do you instruct AWS FARGATE to provision a t2.small via ECS CLI instead of the default micro?

I am trialling AWS ECS for the first time. I've run through the tutorials and now I'm trying to deploy an existing Docker Compose suite which I've been using on Digital Ocean for some time. I have ...
-1
votes
0answers
8 views

How to connect Azure and AWS through VPN?

I need to have a private IP connection between AWS ec2 and Azure VM. I need a VPN connection in between. I followed this blog, but couldn't able to establish a secure tunnel in between. How to solve ...
0
votes
0answers
10 views

AWS EKS CronJob resource not found

I have an Amazon EKS Kubernetes cluster and have the need to run a CronJob on it. However, when I published the manifest to k8s, the object is there, I can list it, get it, but I cannot describe it ...
0
votes
0answers
12 views

How to allow traffic only from cloudflare to AWS ALB?

We have a use case where we wanted to allow only traffic from Cloudflare to the AWS application load balancer, which is the origin for the sub-domains which we have set up in Cloudflare. Anything ...
1
vote
0answers
24 views

How to integrate CI with federated AWS IAM roles?

Imagine a multi tenant environment using a CI (e.g. GitLab but can be any other) and AWS as a backend for test infrastructure. With fixed users, it is easy: save credentials as secrets. But what if ...
1
vote
1answer
16 views

ECS auto deploy with ECR

I'm using github, jenkins, aws ECR, aws ECS. I want to deploy automatically when github have new commit. When github have new commit, github sends a event webhook to jenkins, jenkins builds the ...
0
votes
1answer
8 views

AWS Cloudformation: Callback only for CREATE_COMPLETE or CREATE_FAILED of entire stack

I am creating a CF stack; I have been using the --notification-arns flag of aws cloudformaction create-stack to send notifications to an email topic; however this produces a huge amount of spam, ...
0
votes
1answer
7 views

AWS: Using CloudFront as CDN for non-AWS hosted content

Is there a way (say by providing a Route53 endpoint as origin) to distribute non-AWS hosted content using CloudFront? (assuming the Route53 is used as dns for a site hosted outside of amazon)
3
votes
1answer
29 views

Storing my Lambda Functions on GitHub

Will it be practically possible to build some pipeline; starting from rapid AWS Lambda function development using blueprints, to store them later on a new GitHub repo, that is linked to some CICD ...
1
vote
0answers
17 views

Rancher, Load Balancing and own domain

I have a question about rancher. I'm running my rancher on aws. I have created a new cluster with two nodes (workers) and I have deployed my docker images. Now I wanted to add Load Balancer, but I don'...
2
votes
1answer
26 views

Is there an established metric to describe optimal/needed ressources for a specific computational task?

Let's say I have a piece of software which does a computational task that is pretty demanding to either CPU/GPU/RAM/Disk-IO or a combination of those. Then it would be optimal if one has some metric ...
1
vote
1answer
23 views

Communication between VPCs and a transit VPC hosting VPN Server without Masking source IP

I am setting up a VPN Server to move all resources behind VPN on AWS, which includes moving multiple VPCs. The simple setup is: I have a separate VPC (VPC1) running VPN Server and another VPC (VPC2) ...
1
vote
1answer
32 views

Amazon EKS: using spot instances for worker nodes

When using AWS EKS, is it possible to set up the worker nodes on spot instances? how? Anything I special I should pay attention to, in such a setup?
0
votes
2answers
24 views

Understanding and tweaking AWS policies for job functions

There are quite many possibilities to configure AWS policies; Amazon has therefore provided policies for job functions. Now is it anyhow possible to sneak into JSON code of these policies to learn in ...
0
votes
0answers
11 views

Managing IAM policies with Terraform to implement CRUD of AWS resources

Recently I have discovered this feature request for Terraform to support advanced management of AWS IAM policies, specifically to implement the CRUD (Create, Read, Update, Delete) method. In the ...
0
votes
1answer
47 views

How do I handle multiple AWS accounts in Terraform?

I've read up on Terraform and using AWS S3 and DynamoDB for sharing state and locking. My problem is that we have multiple AWS accounts, by which I mean multiple sign-in locations like: https://...
1
vote
1answer
18 views

Where to state CFT dependencies

With AWS, why can't I just state in the cloudformation template which dependencies I need? Right now I need to add the dependencies automatically in an accompanying script during our gitlab pipeline. ...
3
votes
1answer
61 views

How to monitor AWS S3 cross-region replication process?

Amazon S3 has a cross-region replication which will handle copy of new/updated objects to additional region. The problem is that solution does not provide visibility on state for replication process, ...
1
vote
1answer
22 views

How can I use a local file for a nested Cloudformation stack?

How and is it possible to use a local file for a CloudFormation stack besides an S3 bucket?
1
vote
1answer
101 views

What is the purpose of AssumeRolePolicyDocument in IAM?

I'm confused as to what the purpose of AssumeRolePolicyDocument is. It seems like to create a role all you need is a parent name that you can attach policies to. It seems like AssumeRolePolicyDocument ...
2
votes
1answer
42 views

How to “inject” AWS Lambda code into a CloudFormation?

I'm exercising an idea of not using S3 bucket to refer to the code of a lambda function. The usual example of a lambda CloudFormation code might look like: MyLambda: Type: AWS::Lambda::...
6
votes
1answer
85 views

Best way to launch 100 identical Docker machines on AWS?

I need to do some large scale testing on a system. The system consists of 2 main parts: Manager and Nodes. There will be only one manager server, but 100 nodes. Both the manager and nodes are Docker ...
1
vote
1answer
30 views

Always execute post statement in a jenkins pipeline when a conditional statement is met

Although it seems counterintuitive, I would like to execute an always statement when a conditional is met. In my pipeline, my post statement should always destroy my AWS CloudFormation Stack if a ...
3
votes
1answer
32 views

AWS CLI --profile with duration > 1h

With the AWS CLI you can assume a role using the --profile parameter: aws --profile <profile_name> <service> <command> e.g.: aws --profile admin s3 ls s3://mybucket/ That profile ...
0
votes
0answers
9 views

Can I restart a container within an ECS task group without restarting the entire task?

I know this isn't possible through the AWS portal, but we have a scenario where we would like to restart a container that may have died, which isn't essential. The scenario is along the lines of ...
3
votes
3answers
160 views

DevOps tools and automation of manual processes

This is a general question, but couldn't find a better place to ask. I'm a new DevOps member in a company, and I've been ask to "update" our DevOps technologies. Generally speaking, in what areas do ...
2
votes
1answer
31 views

Do AWS backups of large empty volumes take longer than small ones?

AWS provides backup functionality for RDS databases and snapshots functionality for EBS volumes. Given a small amount of data, would the backup and restore time change depending on whether it's ...
3
votes
1answer
71 views

Blue/green deployment with micro services and DNS

Currently, we have on our test environment an ECS Cluster with micro services deployed. All micro services are talking to each other through Route53 DNS CNAMEs like service1.company.com, service2....
0
votes
0answers
21 views

AWS ElasticBeanstalk Clone Prod to a temporary environment to debug

Is there a good approach to create a copy of prod environment just for devs to debug a bug that couldn't be reproduced or is there any appropriate setup in multi-tenant situation with multiple ...
1
vote
1answer
59 views

Placing an AWS Lambda in a public subnet

Is it possible to place an aws lambda in a public subnet and thus avoid paying for NAT? The docs state the following If your Lambda function needs Internet access, do not attach it to a public ...
0
votes
0answers
31 views

Managing Cloud Formation Templates in SCM and S3 Buckets

I have multiple projects with a CFT stored in Git. However, these CFT files are too large (exceed Amazon's 51k byte limit) and have to be stored in S3. What is an effective method that would allow ...
0
votes
0answers
9 views

AWS ECS: Create the equivalent of kubernetes' ExternalService

I want to set up a microservices-based application on ECS. One of these is a mysql which so far has been a container with volumes for persistence; For several reasons we want to switch to RDS for ...
0
votes
1answer
32 views

AWS: Fargate charging model

According to Amazon's official documentation, For Amazon ECS, AWS Fargate pricing is calculated based on the vCPU and memory resources used from the time you start to download your container ...
2
votes
1answer
109 views

AWS ECS/EKS: EC2 vs Fargate mode

Amazon offers the option of launching their container management services ECS and EKS in two modes: EC2 and Fargate. In the former, normal VMs (EC2 instances) are used and ECS or EKS (depending on ...
0
votes
0answers
40 views

Terraform Project Organization with AWS VPC Peering Connections

How best does one organize a project for AWS that makes use of peering connections. At present my folder structure looks like this modules/ staging/ production/ provisioning/ peering/ I'm also ...
0
votes
0answers
112 views

ECS task fails to start when deploying Docker multi container App in Elastic beanstalk

I have a beanstalk application environment that use multi container docker instances.I have also pushed an image(simple app running a simple node js) to my ECR repository.But whenever i try to ...
0
votes
0answers
29 views

copy task definition in aws ecs

Is there a way to copy ECS Task definitions cross region? I know that there isn't any in the console, and I'm familiar with aws ecs describe-task-definition --task-definition in the CLI. Can I just ...
1
vote
1answer
183 views

Different download speeds from AWS S3 CLI vs Console/Websites

I'm experiencing much slower traffic for the exact same files when downloading (or uploading) them via the AWS website vs. downloading them via the CLI. Is there a known reason for this? Is there ...
0
votes
0answers
9 views

Is it possible to indirectly point to name servers during DNS resolution?

Currently a domain, xyz.com is registered on Gandi. It points to a Route53 hosted zone in AWS Account A. Would it be possible to make yet another hop, this time to AWS Account B? Gandi -> AWS Account ...
0
votes
0answers
14 views

Converting s3 URL to the desired one

I have created a s3 bucket with all permissions and user access through IAM policies. I give the below URL to the customer to access that bucket https://s3.console.aws.amazon.com/s3/buckets/s3-upload-...
2
votes
1answer
45 views

Configure AWS cli inside chef cookbook

I am working on setting up something with S3 and Chef, I have AWS CLI installed and working but I need to figure out how to specify the access ID and the secret access key. I know there are cookbooks ...
3
votes
2answers
36 views

AWS or Azure with usage auto shutdown occasional usage

I'm looking for recommendations on which cloud service provider we should be looking at. The situation: I'm part of a small team looking to leverage more powerful analytics. Most of our day to day ...
3
votes
2answers
50 views

Are Route 53 DNS records aliasing ELBs guaranteed for their lifetime?

Given a Route 53 DNS record aliasing a (classic) load balancer, and the potential for the load balancer ip to change: Is it possible for the DNS record to guarantee that the provided ips are valid ...
1
vote
1answer
27 views

AWS Security Group Creation Using AWS CLI

I have created a security group in AWS. I have added the ingress rule using the below command aws ec2 authorize-security-group-ingress --group-id sg-07xxxx4d --ip-protocol tcp --from-port 22 --to-...
0
votes
0answers
17 views

Deploying to Lambda via a cloud formation script and cannot access assets

I'm currently deploying a very basic NodeJS Lambda function to AWS using the Serverless framework. I need to access a chrome dependency which is located inside a /lib directory. I access it with ...
3
votes
2answers
247 views

Amazon EKS from local kubectl does not cache MFA token/session

I have set up an EKS cluster in AWS. My user-account there is secured with MFA. And I have an assumerole, that is allowed to manage my infrastructure. So I installed and configured my system as ...
1
vote
1answer
36 views

How do I configure an AWS network load balancer with an A record in Cloudflare

I am trying to use an AWS Network Load Balancer to point at a group of servers. I would then like to take my DNS and point it at the load balancer. However, after I set everything up I cannot find and ...
2
votes
1answer
53 views

Is running load balanced autoscale apps cheaper on AWS Kubernetes than just using EC2 resources?

We're running like 100+ servers on AWS EC2 with like 20 microservices all load balanced and autoscaled with 2 to 3 instances. The cost has become....very significant. I'm wondering if migrating ...
1
vote
1answer
16 views

I have an custom AMI and want to run certain config commands at initial boot, depending on the autoscale instance that starts it. How do I do this?

I have a custom AMI that contains the dependencies for several applications. The only difference between the applications is several configuration options that can be configured by a bash script. (i....