Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Join us in building a kind, collaborative learning community via our updated Code of Conduct.

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

0
votes
0answers
5 views

Converting s3 URL to the desired one

I have created a s3 bucket with all permissions and user access through IAM policies. I give the below URL to the customer to access that bucket https://s3.console.aws.amazon.com/s3/buckets/s3-upload-...
2
votes
1answer
10 views

Configure AWS cli inside chef cookbook

I am working on setting up something with S3 and Chef, I have AWS CLI installed and working but I need to figure out how to specify the access ID and the secret access key. I know there are cookbooks ...
1
vote
1answer
14 views

AWS or Azure with usage auto shutdown occasional usage

I'm looking for recommendations on which cloud service provider we should be looking at. The situation: I'm part of a small team looking to leverage more powerful analytics. Most of our day to day ...
2
votes
2answers
35 views

Are Route 53 DNS records aliasing ELBs guaranteed for their lifetime?

Given a Route 53 DNS record aliasing a (classic) load balancer, and the potential for the load balancer ip to change: Is it possible for the DNS record to guarantee that the provided ips are valid ...
0
votes
1answer
10 views

AWS Security Group Creation Using AWS CLI

I have created a security group in AWS. I have added the ingress rule using the below command aws ec2 authorize-security-group-ingress --group-id sg-07xxxx4d --ip-protocol tcp --from-port 22 --to-...
0
votes
0answers
16 views

Deploying to Lambda via a cloud formation script and cannot access assets

I'm currently deploying a very basic NodeJS Lambda function to AWS using the Serverless framework. I need to access a chrome dependency which is located inside a /lib directory. I access it with ...
1
vote
1answer
33 views

Amazon EKS from local kubectl does not cache MFA token/session

I have set up an EKS cluster in AWS. My user-account there is secured with MFA. And I have an assumerole, that is allowed to manage my infrastructure. So I installed and configured my system as ...
0
votes
1answer
18 views

How do I configure an AWS network load balancer with an A record in Cloudflare

I am trying to use an AWS Network Load Balancer to point at a group of servers. I would then like to take my DNS and point it at the load balancer. However, after I set everything up I cannot find and ...
-1
votes
0answers
15 views

Cloudformation Error: Value of property VPCSecurityGroups must be of type List of String

Below is a part of the cloud formation template. Here am trying to create a RDS instance with the existing security group "ExistingSecurityGroup" for the Development environment and for the other ...
1
vote
1answer
33 views

Is running load balanced autoscale apps cheaper on AWS Kubernetes than just using EC2 resources?

We're running like 100+ servers on AWS EC2 with like 20 microservices all load balanced and autoscaled with 2 to 3 instances. The cost has become....very significant. I'm wondering if migrating ...
0
votes
1answer
13 views

I have an custom AMI and want to run certain config commands at initial boot, depending on the autoscale instance that starts it. How do I do this?

I have a custom AMI that contains the dependencies for several applications. The only difference between the applications is several configuration options that can be configured by a bash script. (i....
2
votes
1answer
34 views

AWS: Application vs Classic Load Balancer

My senario is this: I am using 2 EC2 instances which I want reachable via urls as follows: sub1.domain.com sub2.domain.com I am aware of the fact that AWS Application Load Balancers currently ...
-2
votes
2answers
45 views

Why does amazon charge for free tier usage?

I have an issue with amazon free tier account, I have deployed two EC2 instances (1 linux and 1 windows) on amazon each having 30GB of storage which is permissible under free tier, these instances are ...
0
votes
0answers
17 views

ACM SSL certificate with Elastic Beanstalk

We switched from Comodo wild-card SSL CA to a free version from AWS through the Certificate Manager. The domain is registered on Namecheap and the only way we could get the website to route traffic ...
0
votes
1answer
24 views

How to create AWS application load balancer using saltstack

I was trying to create application load balancer with salt stack. I am using salt boto_elbv2 which is having option to create target groups but dont have option to create load balancer, how can i ...
1
vote
1answer
41 views

Bad practice having a single SSH gateway with access to all environments?

I have started at a new company and am in the process of locking down SSH access to be through a single SSH gateway server. My question is, should I create a separate SSH gateway server for each ...
0
votes
1answer
31 views

Processing message queues quickly without wasting money on AWS Lambda

What are some strategies and patterns for processing message queues quickly? I have a Lambda function that is invoked on a schedule every x minutes to process a number of messages in the queue. I ...
1
vote
2answers
156 views

What's the best complete DevOps setup?

I'm curious what everyone recommends. Vagrant is for setting up test environments right? Ansible/Chef etc. seem good for servers you own, but what about cloud? Docker... great for standardizing app, ...
1
vote
0answers
38 views

Provisioning times for Redis in cloud taking too long, how can we shorten it?

Provisioning a 1 GB Redis cache service on AWS takes around 8 minutes. Doing the same on Azure takes around 16 minutes. Ours Terraform scripts need the call back from the Redis systems. Why is this ...
0
votes
1answer
14 views

What tools should I deploy to support AWS for a Managed Services company?

I work for a managed services company and am working out a plan to retrofit our customer support machines to support AWS in a general way. We use Ansible and lots of ssh port forwarding to connect ...
2
votes
0answers
27 views

Trade offs of putting an international master database in us-west-2

I'm hoping this isn't so open ended that it veers towards a "discussion" more than an "answerable" question. I need to place an RDS Postgres instance in an AWS region that will act as the master DB ...
-1
votes
1answer
17 views

Python Dictionary [closed]

I am getting the output from my previous executions something like this: [{u'Value': '2018-06-21', u'Key': 'Deletion_Date'}] I want to get only 2018-06-21 saved in a variable. I tried this ...
0
votes
0answers
10 views

Saving core dumps when AWS restarts a docker container

I have a Java Spring application running in a Docker container on AWS. When the Spring process is dead, the AWS is configured to automatically restart the Dockercontainer. This deletes any heap dump ...
1
vote
0answers
37 views

Monitor Jenkins node/slave health

For a project i'm working on we need to create a Jenkins node in an AWS environment. For this we will work with the docker image which is available on https://github.com/jenkinsci/docker-ssh-slave ...
2
votes
1answer
103 views

Terraform AWS AZ error - manually specify AZ?

I'm fairly new to terraform and when creating AWS infrastructure I use the following to fetch the 'available' availability zones for my region (us-east-1) where I'm trying to create an EKS cluster. ...
1
vote
1answer
100 views

How can I simulate failure of an AWS Availability Zone?

In order to test that our load balancers and Multi-AZ RDS instances are working the way I'd expect them to, I'd like to simulate failure of an AWS Availability Zone. Short of locating one of the ...
1
vote
1answer
26 views

Terraform Issue - Can't find Data Source in Sub Module?

I'm fairly new to Terraform and have been following this example on creating an EKS cluster - https://github.com/terraform-providers/terraform-provider-aws/tree/master/examples/eks-getting-started ...
0
votes
1answer
24 views

Copying a file with special character & spaces

I have been trying to copy a file from my remote server to AWS s3, but the file name is quite weird and I am not able to figure it out what can I do. I tried using escape characters but that did not ...
0
votes
1answer
33 views

Way to Connect to all ec2-instances one by one

Is there any way through which I can connect to all ec2-instances one by one through Python script to extract some server information from there. Please note that all ec2-instances lies behind a ...
0
votes
1answer
27 views

Amazon Web Service (AWS): Spot request active followed by cancelled terminating

5/31/2018, 5:21:51 PM fleetRequestChange cancelled 5/31/2018, 5:15:46 PM fleetRequestChange cancelled_terminating 5/31/2018, 5:15:46 PM fleetRequestChange active 5/31/2018, 5:15:...
0
votes
0answers
34 views

Database choice suggestion

I would like to create a database to store how often access tokens in my system are being used. I was thinking of a data model like so - Access Token from (basically I will store this hourly, so ...
4
votes
1answer
66 views

DevOps SOX Compliance

I'm coming from the dark side, compliance, and am looking to gain better knowledge on DevOps & how to implement SOX controls on these processes. I'm hoping to build a good knowledge base in order ...
1
vote
1answer
16 views

Cross Region Copy of Aurora Snapshots

current_date = str(dt.now().strftime('%Y-%m-%d')) target_cluster_snapshot_arn= current_date+'_Development_Aurora' response = TARGET_CLIENT.copy_db_cluster_snapshot( ...
0
votes
0answers
12 views

how to add an node to my kops cluster? (node in here is my external instance)

I have created a kubernetes cluster on AWS, as by following below instruction. All my master and worker nodes of Ubuntu OS type. https://jee-appy.blogspot.in/2017/10/setup-kubernetes-cluster-kops-...
1
vote
1answer
53 views

does boto3 have a way to get resource limits from a region?

Right now I am looking for ec2 instances type limits for a given region. I would like to put in place an audit script that tracks our usage vs our limits for a given set of things. Also open to ...
0
votes
0answers
20 views

Managing Security in an S3 Data Lake

I am creating a design proposal for a data lake hosted in S3. My goal is to create a flat data lake that will host a variety objects within it. The majority of these objects will be made available to ...
0
votes
1answer
35 views

Deploying a SaaS solution which is custom for every customer

So we have 5 repositories (Individual web services ex. CMS/E-commerce and internal APIs) which are currently deployed as Docker containers. What we plan to do is to use these services and make a ...
1
vote
0answers
51 views

How Can I Easily View Build Artifacts From AWS CodePipeline / CodeBuild?

I'm creating a project with the nodejs + AWS Lambda + express template in AWS CodeStar, and I'm using CodePipeline and CodeBuild to build and deploy the project. It also runs tests, and it would be ...
2
votes
1answer
29 views

Storage gateway reset cache

I have a problem in the storage gateway: the cache volume is full. When we look at the operating system there is still space available on that volume. Based on the referenced aws model, only the ...
1
vote
0answers
166 views

Configuration of AWS CodePipeline for Android CI/CD

I'm trying to set up a basic CI/CD pipeline for an Android project using AWS CodePipeline and I have 3 steps in the pipeline as follows: Source: Pull project from GitHub repo Build: Build the android ...
3
votes
1answer
57 views

AWS CodePipeline staged deployments

I am implementing a CICD pipeline using CodePipeline, CodeCommit, CodeDeploy and CloudFormation (I skipped the build part of the pipeline and am going to commit built code for the moment). I already ...
1
vote
1answer
47 views

Saving time on an EC2 instance

I have started playing around with AWS (privately). I have one free tier Amazon Linux 2 VM running right now, which serves a "fat" service (in a docker container) to myself and one other person. It ...
1
vote
2answers
110 views

How can I become a DevOps Engineer? [closed]

Please suggest me a right path to this DevOps career. From blogs Im not getting a well defined path. What all courses I have to take.
0
votes
0answers
16 views

Designing parameterized custom default security groups for VPCs in AWS

I plan to restrict creation and modification of security groups for my developers. Instead, provide them with a custom-made Security Groups CloudFormation template. As I create a parameterized ...
2
votes
2answers
70 views

Challenges of using AWS Lambda chain

Context: I have a pipeline of 6 lambda functions (chained together), triggered by an SNS notification which is generated whenever a file lands on S3. This pipeline essentially takes the file(few GBs), ...
0
votes
2answers
60 views

AWS REST API Query

How to authenticate against AWS to make API query ? https://iam.amazonaws.com/?Action=ListAttachedUserPolicies&UserName=ja&Version=2010-05-08&accesskey and getting: <Code>...
3
votes
1answer
66 views

Docker managers are losing quorum on AWS

I have deployed Docker EE on AWS by choosing the package directly from the AWS Marketplace: Docker EE for AWS (Standard/Advanced) - BYOL. The cluster has been successfully launched and deployed on AWS....
0
votes
0answers
31 views

aws ecs jenkins on-demand agents not terminating after use

Looking for help troubleshooting an intermittent issue; We run an Ubuntu version of Jenkins on AWS infrastructure using on-demand spot ECS instances. I've noticed that while most agents spin down and ...
5
votes
2answers
73 views

How to automate rolling upgrades for ec2 running linux behind elastic and/or application load balancer?

Would like to ask for recommendations on ready automated solutions or templates for rolling ec2 instance upgrade on AWS, requiring a reboot with ELB/ALB. Specifically required to perform the ...
1
vote
1answer
110 views

Multiple builds from one branch but different CSS values

Looking for advice on how best to configure my workflow. I have an application, that we currently customise for clients (white label) but our OLD devs have made the deployment of this very messy, ...