Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

Filter by
Sorted by
Tagged with
3
votes
1answer
5k views

How to “inject” AWS Lambda code into a CloudFormation?

I'm exercising an idea of not using S3 bucket to refer to the code of a lambda function. The usual example of a lambda CloudFormation code might look like: MyLambda: Type: AWS::Lambda::...
3
votes
2answers
4k views

Placing an AWS Lambda in a public subnet

Is it possible to place an aws lambda in a public subnet and thus avoid paying for NAT? The docs state the following If your Lambda function needs Internet access, do not attach it to a public ...
3
votes
1answer
379 views

AWS: Application vs Classic Load Balancer

My senario is this: I am using 2 EC2 instances which I want reachable via urls as follows: sub1.domain.com sub2.domain.com I am aware of the fact that AWS Application Load Balancers currently ...
3
votes
2answers
5k views

How can I simulate failure of an AWS Availability Zone?

In order to test that our load balancers and Multi-AZ RDS instances are working the way I'd expect them to, I'd like to simulate failure of an AWS Availability Zone. Short of locating one of the ...
3
votes
1answer
83 views

Saving time on an EC2 instance

I have started playing around with AWS (privately). I have one free tier Amazon Linux 2 VM running right now, which serves a "fat" service (in a docker container) to myself and one other person. It ...
3
votes
1answer
24 views

Provisioning a server on behalf of a user on GCP/AWS/Azure and probably relinquish access

I'd like to build a service where I run a custom setup script on behalf of a user on an t2.micro equivalent instance but be able to probably relinquish access to the server. Any advice on the tech ...
3
votes
1answer
354 views

Configure AWS cli inside chef cookbook

I am working on setting up something with S3 and Chef, I have AWS CLI installed and working but I need to figure out how to specify the access ID and the secret access key. I know there are cookbooks ...
3
votes
2answers
56 views

Are Route 53 DNS records aliasing ELBs guaranteed for their lifetime?

Given a Route 53 DNS record aliasing a (classic) load balancer, and the potential for the load balancer ip to change: Is it possible for the DNS record to guarantee that the provided ips are valid ...
3
votes
1answer
71 views

Is running load balanced autoscale apps cheaper on AWS Kubernetes than just using EC2 resources?

We're running like 100+ servers on AWS EC2 with like 20 microservices all load balanced and autoscaled with 2 to 3 instances. The cost has become....very significant. I'm wondering if migrating ...
3
votes
1answer
251 views

Is it possible to package an application in a .nupkg when creating an application revision in AWS CodeDeploy?

My build process packages my application in a .nupkg instead of a .zip. Assuming my .nupkg contains a correctly-implemented appspec.yml and is otherwise appropriately bundled, can my deployment ...
3
votes
2answers
87 views

AWS Temporary Permission Granting Tool for Account/Service “Firefights”

I'm looking for a service or third party solution that allows for granting temporary access to an IAM user (or group) to one or more services in an AWS account. The example I have is there is an ...
3
votes
1answer
60 views

AWS CLI --profile with duration > 1h

With the AWS CLI you can assume a role using the --profile parameter: aws --profile <profile_name> <service> <command> e.g.: aws --profile admin s3 ls s3://mybucket/ That profile ...
3
votes
1answer
198 views

AWS Batch use existing ECS cluster

I would like AWS Batch to use one of my existing ECS clusters. The problem is that when I create an unmanaged "compute environment" from the AWS Batch service, it doesn't allow me to specify an ...
3
votes
1answer
252 views

How do you instruct AWS FARGATE to provision a t2.small via ECS CLI instead of the default micro?

I am trialling AWS ECS for the first time. I've run through the tutorials and now I'm trying to deploy an existing Docker Compose suite which I've been using on Digital Ocean for some time. I have ...
3
votes
1answer
225 views

Storage gateway reset cache

I have a problem in the storage gateway: the cache volume is full. When we look at the operating system there is still space available on that volume. Based on the referenced aws model, only the ...
2
votes
2answers
778 views

What's the best complete DevOps setup?

I'm curious what everyone recommends. Vagrant is for setting up test environments right? Ansible/Chef etc. seem good for servers you own, but what about cloud? Docker... great for standardizing app, ...
2
votes
2answers
128 views

When is it not appropriate to use serverless technology such as AWS Lambda?

With serverless computing using AWS lambda, Amazon(AWS) is taking the ownership of architecture, administration & deployment aspect of AWS services(VPC/EC2/ELB/AScaling/Rtables/SGroups/etc...) for ...
2
votes
3answers
84 views

What makes a difference between high-cost cloud providers and low-cost ones?

I need to decide, for a small client and a small budget (around $500 a month) the proper Cloud Provider to have some compute instances to hold a web server, a database and an Apache server. I was ...
2
votes
1answer
66 views

is it possible to connect an AWS autoscaling group with an application load balancer?

I'm working with AWS cloudformation I have an autoscaling group for a couple of machines running an API server, and I would like to set up an application load balancer as a single entry point, so that ...
2
votes
4answers
5k views

Is it possible to mount an s3 bucket as a point in a docker container?

I have a Java EE packaged as war file stored in an AWS s3 bucket. I will like to mount the folder containing the .war file as a point in my docker container. I have managed to do this on my local ...
2
votes
1answer
27 views

How to create ALB that can handle traffic on 2 ports

I want my HTTP traffic on port 3701 and my WS (websocket) traffic on 3702. For a moment I thought that using 2 target groups was the answer, but there doesn't seem to be a way to differentiate between ...
2
votes
1answer
4k views

Access S3 files from Datacenter over VPN to VPC

I am trying to access S3 files from non-EC2 machine. non-EC2 machine is connected to VPC over VPN, also can reach to other hosts in VPC. Created VPC Endpoint for S3 Main routing table of VPC has ...
2
votes
1answer
22 views

I have an custom AMI and want to run certain config commands at initial boot, depending on the autoscale instance that starts it. How do I do this?

I have a custom AMI that contains the dependencies for several applications. The only difference between the applications is several configuration options that can be configured by a bash script. (i....
2
votes
1answer
76 views

Are manual changes to an aws IAM policy detected by Terraform plan?

I know that Terraform dose some checks before the plan and can detect some changes but not others such as detecting changes to variables on a lambda but not detecting a new secret in a secret manager. ...
2
votes
1answer
38 views

amazon ec2 ip whitelisted on a third party service provider

Currently we are running an application in a single amazon ec2 machine. On our application we are using some third party solution. For using those solution, we have asked the third party service ...
2
votes
1answer
109 views

Cloud agnostic infrastructure automation better than terraform?

Are there any infrastructure automation technologies which do a better job at being portable than terraform? We heavily leverage terraform as it is a cloud-agnostic technology (vs, say, ARM templates ...
2
votes
1answer
384 views

For storing avatars in s3, which approach has the lowest cost?

On my site I have the ability for users to upload avatars (which they upload to s3). They can only have one avatar at the moment, so I currently just have the filename set to their user id. However, ...
2
votes
1answer
408 views

How to Block Traffic From a Single IP in AWS

Our server being hammered by traffic from some particular IP. It was causing a 20x increase in traffic to some URLs. So I wanted to block all traffic from that single IP.
2
votes
2answers
6k views

Transfer files and execute commands from jenkins scripted pipeline to AWS instance

I want to transfer files and execute a few commands on remote AWS instance from Jenkins. I have the following methods in mind to do the same. Note that my Jenkins server is running in the local server,...
2
votes
1answer
952 views

Configuration of AWS CodePipeline for Android CI/CD

I'm trying to set up a basic CI/CD pipeline for an Android project using AWS CodePipeline and I have 3 steps in the pipeline as follows: Source: Pull project from GitHub repo Build: Build the android ...
2
votes
1answer
43 views

Is it possible to load an image into S3 via an URL?

I'm going through some steps documented in How Do I Upload Files and Folders to an S3 Bucket? to get my ova into S3. Seems like a waste of time for me to download it and then upload it, is there a ...
2
votes
1answer
260 views

AWS Security group rule for certbot renewal

I want to add a rule to my aws security group to allow for incoming traffic from the acme server (I guess it is acme-v01.api.letsencrypt.org) to issue and automate the renewal of my cert; What is the ...
2
votes
1answer
45 views

Is JS an reasonable choice for a DevOps internal tool (i.e. cloud-formation runner, scripts)?

I'm working on a project to move our current stack from a mix of half-manual, half-undocumented, half-ansible into a solid code-defined architecture on AWS. Our plan is to use AWS CloudFormation ...
2
votes
1answer
240 views

Terraform ignore_changes block on JSON-encoded attribute

I'm currently trying to get CloudWatch logging and DMS configuration working smoothly in my module by ignoring certain attributes on replication_task_settings. Right now, I have a DMS replication task ...
2
votes
1answer
599 views

Can I use AWS Step Functions to launch many different fargate 'runs'?

I am building a service that has two independent steps. The first step is a data transformation step that has to happen and is common to all downstream processes, then the second is starting a few ...
2
votes
1answer
113 views

Get tagging to work on AWS CLI

I am trying to tag commit hash and app version onto the ECS service to make it easier for developers to identify the service with the code. But I get this error + aws ecs tag-resource --resource-...
2
votes
1answer
87 views

Terraform fails to modify DNS settings a recently created VPC Peering connection because it is not yet active

I have the following configuration file: environment/main.tf: resource "aws_vpc_peering_connection" "sb_vpc_peering" { vpc_id = var.vpc_id peer_vpc_id = var.peer_vpc_id peer_region = var....
2
votes
1answer
28 views

AWS Credentials - What are multi region user/role management best practices?

In the past, I've usually had separate accounts for each region that I've worked in. These accounts had different IAM roles/etc, so there was very little chance I'd inadvertently mess up region A ...
2
votes
2answers
262 views

Terraform - how to modify a existing S3 bucket that was created from module?

I already have my S3 bucket called foo-name created and existing with terraform. I want to modify the existing s3 bucket and a policy. But when I do this it seems to want to add a new s3 bucket ...
2
votes
1answer
41 views

What is the difference between EKS and EC2 installed kubernets?

I'm newbie in AWS usage. I don't understand the difference between EKS and EC2 installed kubernets? Amazon EKS makes it easy for you to run Kubernetes on AWS without needing to install and ...
2
votes
1answer
68 views

Container for every user

Please help me here based on your experiences. We have launched a desktop application where users can download all their online data from several platforms at one place. Our motto is to provide users ...
2
votes
2answers
232 views

How to handle AWS Offsite or cross-account RDS (mysql) backups?

AWS Provides a great solution to provide point-in-time recovery backups within RDS. However, while we take every measure to protect the root account, I'm paranoid that if someone were to gain access ...
2
votes
1answer
5k views

How can you pass private environment variables to FARGATE tasks specified from a Docker Compose config

I am using an existing docker-compose.yml to migrate an app to ECS. The config references several $ENV vars which I used to pass in simply as environment variables when running docker-compose up. One ...
2
votes
2answers
1k views

ECS auto deploy with ECR

I'm using github, jenkins, aws ECR, aws ECS. I want to deploy automatically when github have new commit. When github have new commit, github sends a event webhook to jenkins, jenkins builds the ...
2
votes
1answer
280 views

Storing my Lambda Functions on GitHub

Will it be practically possible to build some pipeline; starting from rapid AWS Lambda function development using blueprints, to store them later on a new GitHub repo, that is linked to some CICD ...
2
votes
1answer
34 views

Do AWS backups of large empty volumes take longer than small ones?

AWS provides backup functionality for RDS databases and snapshots functionality for EBS volumes. Given a small amount of data, would the backup and restore time change depending on whether it's ...
2
votes
1answer
54 views

Custom Layer 4 Load Balancer

What are my best options for deploying a load balancer on AWS with the following requirments: Add auto scaling that will start my own EC2 instances. Deploy 3rd party SW on the load balancer. ...
2
votes
1answer
92 views

How do I release multiple projects to same domain using AWS when developer commit the latest code change

I have multiple projects on Github and I need to release each project on same domain different paths when developer commit code changes. Example: I have Github repositories like below CRM CMS Main-...
2
votes
1answer
21 views

Data processing infrastructure

We are building a system for data science in AWS and our flow is pretty simple. Get the data - From redis get the model - From FSx/EBS run. This process script should take something like 5-10 ...
2
votes
1answer
39 views

AWS hosting of SPA Web App

I have just recently started to consider using AWS for my SPA Web Apps. And I have read a lot about different types of how web apps could be hosted on AWS. I have looked into Lambda, S3 Static hosting....

1 2
3
4 5
9