Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

Filter by
Sorted by
Tagged with
1
vote
1answer
58 views

What is the best way to set up a CI/CD pipeline on ECS?

There are so many options: Docker-compose with ECS cli looks the easiest solution Terraform CloudFormation (looks complex!) Ansible I am only interested in setting up a basic ECS docker set-up ...
1
vote
1answer
20 views

Are there serious problems with an EC2 auto-scaling AMI that automatically downloads newest server from git?

I'm converting some servers from manual scaling (with a load balancer) to auto-scaling. I'm currently using an Ansible script to manage upgrades, and I wouldn't want an automatically created instance ...
0
votes
1answer
18 views

Issue with cloudformation in target groups and ASG

I am trying to use cloudformation to setup a ASG and I have a target group which I would like to associate with the ASG. The target group is created okay but when I go to attach it to the ASG I get an ...
1
vote
1answer
110 views

What are the advantages of using AWS nameservers as opposed to servers provided by other registrars?

I am transfering a domain name from namecheap to aws route 53 service. AWS provides you with three options when transfering: Continue to use the name servers provided by the current registrar or DNS ...
3
votes
0answers
917 views

Defining and using bash functions in AWS CodeBuild

I thought I could slightly improve readability of repetitive sed calls when inserting secrets into a file with AWS CodeBuild. I defined a bash function: replaceConfig() { sed -i 's|{'$1'}|'${!1}'|' ...
0
votes
3answers
364 views

How can I list all environment variables configured in Terraform?

I configured AWS provider in Terraform by providing an access key and secret as environment variables according to the documentation: $ export AWS_ACCESS_KEY_ID="anaccesskey" $ export ...
0
votes
1answer
92 views

Find relevant domain/hosted zone under which to host subdomain

Context In Terraform, to create a new domain record, I first need to find the zone under which it should be hosted. E.g. If I want to create a DNS record for mysite.example.com, I'd get the zone ...
7
votes
3answers
398 views

Who should write Docker files?

Once again company debate rages on who should write Docker files (including compose, interchangeable for this post). The scenario is common in my work (developer and consultant) and I wanted to know ...
0
votes
1answer
32 views

How can I check when a subnet was created?

There's an unexpected subnet that isn't anywhere in my project I think it was created manually but I can't find when it was created to help descover what it is for and if it's still needed?
1
vote
1answer
3k views

AWS API Gateway: 403 forbidden with disabled API key; error from cloudfront

How can happen that with a Lambda/API Gateway combination, if no explicit Cloud Front configuration has been done, in an error response header they mention CloudFront? header: x-amzn-ErrorType: ...
1
vote
1answer
2k views

How to programmatically enable and disable SQS triggering AWS Lambda?

I have a requirement where I want to stop my lambda from receiving messages from SQS. And I want to implement this like an API which can toggle between the disabling and enabling of the AWS Lambda ...
1
vote
1answer
80 views

Running AWS lambda in serial (for a given parameter)

I'm not sure if this is the best place to ask this. But we've currently got something in Microsoft Azure where we have their serverless functions (Azure Functions) running in serial based off a ...
1
vote
2answers
792 views

Why do I need a Nat Gateway for ECS containers using AWSVPC?

So here is a scenario: I have a route table that routes all traffic to the internet gateway, and I have a subnet associated with that route table, which makes it a public subnet. Now I create another ...
1
vote
1answer
57 views

Sending HTTP requests to private EC2 DNS from other EC2 host works, but not from container on EC2 host

I want to make a container hosted on one EC2 host communicate with another container hosted on another EC2 host. Currently, if I send an HTTP request from host A to host B using host B's private DNS ...
1
vote
1answer
88 views

Unable to send cloudwatch logs to loggly using a blueprint lambda - Invalid ciphertext

I am trying to use the loggly Lambda blueprint to send cloudwatch logs to loggly. I am doing this because I have a bunch of lambdas that I need to have a single point of viewing logs. I've followed ...
3
votes
3answers
451 views

Accessing a AWS docker instance via localhost only?

Suppose I have two apps launched via the AWS ECS cluster (using Docker containers). I want to expose one app to the world via a public IP (and I do it via the AWS load balancer) but the other one I ...
0
votes
0answers
939 views

SQS Error Message: The specified queue does not exist for this wsdl version

I have a Lambda function that is created inside a serverless framework setup. I am trying to pass in a queue url as an ENV variable, when I do that it results in the below error message. I've checked ...
2
votes
1answer
134 views

Are manual changes to an aws IAM policy detected by Terraform plan?

I know that Terraform dose some checks before the plan and can detect some changes but not others such as detecting changes to variables on a lambda but not detecting a new secret in a secret manager. ...
3
votes
2answers
122 views

AWS Temporary Permission Granting Tool for Account/Service "Firefights"

I'm looking for a service or third party solution that allows for granting temporary access to an IAM user (or group) to one or more services in an AWS account. The example I have is there is an ...
2
votes
1answer
1k views

Can I use AWS Step Functions to launch many different fargate 'runs'?

I am building a service that has two independent steps. The first step is a data transformation step that has to happen and is common to all downstream processes, then the second is starting a few ...
3
votes
0answers
127 views

How to deploy StatsD listening on UDP in kubernetes with external loadbalancer on AWS?

Our goal is to have StatsD deployed on k8s cluster running on AWS. Currently all existing applications using UDP to send StatsD metrics. As we understood from the kubernetes docs and tests we ...
1
vote
1answer
18 views

AWS Setting instance to use domain from another account

We're transitioning between accounts and we have an app on our new account but we want to use the domain from our old account. We plan on shutting off the old account soon and transitioning everything ...
1
vote
1answer
345 views

Use Sqlite database on ECS

I have an application which uses SQLite database and want to migrate it to AWS ECS service. It's dockerized and have access to DB file via mounted volume. Is there a way to make this work with ECS? (...
2
votes
1answer
155 views

Cross Account EC2 Access from within Amazon Workspace

I have a requirement to setup a bastion host (Amazon Workspace) to connect to an ec2 instance living on a different account. As Amazon Workspaces cannot assume a role the way EC2s can, A cross ...
1
vote
1answer
105 views

Best AWS EC2 instance class for general Kubernetes cluster

Hi We are deploying a fairly standard multiple purpose (data replication workers and some nginx web proxies) in an EKS cluster, and wondering what EC2 instance class people recommend for this workload....
2
votes
1answer
179 views

Get tagging to work on AWS CLI

I am trying to tag commit hash and app version onto the ECS service to make it easier for developers to identify the service with the code. But I get this error + aws ecs tag-resource --resource-...
4
votes
2answers
58 views

One NAT attachment for two private subnets

I have two NAT gateway attachments for two private subnets in AWS. Is it possible to have one NAT gateway attachment for two private subnets so that I can save one EIP?
2
votes
1answer
92 views

is it possible to connect an AWS autoscaling group with an application load balancer?

I'm working with AWS cloudformation I have an autoscaling group for a couple of machines running an API server, and I would like to set up an application load balancer as a single entry point, so that ...
2
votes
1answer
42 views

amazon ec2 ip whitelisted on a third party service provider

Currently we are running an application in a single amazon ec2 machine. On our application we are using some third party solution. For using those solution, we have asked the third party service ...
0
votes
2answers
60 views

EKS - created cluster from console with federated IAM admin - how to access

I have no programmatic access for the user who created the cluster only graphical. I tried a lot of things and I always get access denied on kubectl as I have to use another IAM identity that has ...
0
votes
1answer
34 views

How to set Deployment Type using ECS First Run Wizard

The AWS ECS First Run Wizard provides no option for choosing the 'Deployment type' of the ECS Service: Whereas the ECS Service creation screen does: Why does the First Run Wizard not allow for ...
2
votes
1answer
132 views

Terraform fails to modify DNS settings a recently created VPC Peering connection because it is not yet active

I have the following configuration file: environment/main.tf: resource "aws_vpc_peering_connection" "sb_vpc_peering" { vpc_id = var.vpc_id peer_vpc_id = var.peer_vpc_id peer_region = var....
1
vote
1answer
30 views

AWS: Onboarding on premise instance

Is there a way to onboard the Raspberrypi device in AWS. So that the same device can be managed using ec2 console and it can seamlessly work with the rest of AWS services? I am just an experimental ...
2
votes
1answer
55 views

I want to scale up/down as fast as AWS Lambda but also be able to allocate the vCPU (minimum 8) per task, any advice?

Goal So I'm looking for an AWS product or combination of products to accomplish the following: Ability to do CPU heavy (non-parallel) calculations (min 8 vCPU's per node) Minimum timeout limit of ...
6
votes
4answers
5k views

How do I run Terraform with AWS MFA?

I'm using Terraform with the terraform-provider-aws provider to manage my AWS infrastructure. I'm trying to enable mfa_delete on an S3 bucket, but when I try to apply the change I get this error: 1 ...
2
votes
1answer
30 views

AWS Credentials - What are multi region user/role management best practices?

In the past, I've usually had separate accounts for each region that I've worked in. These accounts had different IAM roles/etc, so there was very little chance I'd inadvertently mess up region A ...
1
vote
1answer
52 views

Is there a way through which I can control type of load balancer like round robin , least-connections etc using helm charts?

I am researching different types of loadbalancing methods available through kubernetes .I want to implement & see before deciding on one .I'm stuck at how to actually define typeof-loadbalancer.If ...
2
votes
1answer
2k views

Terraform error Reference to “count” in non-counted context for resources not necessarily data

here's my part of my code that I am having issues with. Unfortunately I could not understand the relationship between the last answer, despite being almost what I need, and my situation. data "...
3
votes
2answers
365 views

Terraform - how to modify a existing S3 bucket that was created from module?

I already have my S3 bucket called foo-name created and existing with terraform. I want to modify the existing s3 bucket and a policy. But when I do this it seems to want to add a new s3 bucket ...
2
votes
1answer
32 views

How to deploy a Kubernetes service using NodePort on AWS?

I have created a cluster on AWS EC2 using kops consisting of a master node and two worker nodes, all with public IPv4 assigned. Now, I want to create a deployment with a service using NodePort to ...
7
votes
1answer
608 views

Should AWS arn values be treated as secrets?

I have a configuration file that contains AWS resource arn's stored in a Github repo. This includes some arn's of AWS IAM role resources. Should these be treated as if they are a secret value, and not ...
2
votes
1answer
743 views

Terraform: can't connect to AWS provider using shared config file or static variable

I'm trying to use terraform to manage AWS resources and trying to set up the credentials configuration. I'm following the official documentation: https://www.terraform.io/docs/providers/aws/index.html ...
1
vote
1answer
1k views

AWS API Gateway as an http proxy to ALB

I have a setup of API Gateway proxying all the requests to my EC2 instances behind load balancer (ALB). But I want api endpoint to have a nice domain my-api.mydomain.com. I'm trying to accomplish that ...
5
votes
2answers
1k views

How to `terraform destroy` an `aws_instance` without also destroying its `aws_ebs_volume` (separate resource)

$ terraform -version Terraform v0.12.21 + provider.aws v2.34.0 Given a terraform configuration for one set of single aws_instance, aws_ebs_volume and aws_volume_attachment resources, each named, say,...
2
votes
1answer
60 views

SFTP server with third party user management system?

I understand how to set up SFTP servers on Linux and create users and their passwords manually. So basically, the users get authenticated as normal Linux users get authenticated through /etc/passwd. ...
1
vote
1answer
9 views

Unable to start step function after account move

I recently moved my development account away from my prod one, everything seemed fine except I have a service that runs a lambda to start a step function - not ideal but used to work. My issue comes ...
1
vote
1answer
431 views

AWS launch template create-before-destory?

In terraform, to reduce downtime when creating a new auto-scaling-group behind an existing load balancer, you can use a launch configuration and set create-before-destroy. Launch templates are the ...
-1
votes
1answer
42 views

AWS organizations and Billing

I was using an AWS account with my credit card info and my personal account. Since I'm learning my way around AWS services I am using free tier as much as I can but I still have some small charges ...
2
votes
1answer
127 views

Cloud agnostic infrastructure automation better than terraform?

Are there any infrastructure automation technologies which do a better job at being portable than terraform? We heavily leverage terraform as it is a cloud-agnostic technology (vs, say, ARM templates ...
0
votes
1answer
27 views

Is there a limitation in AWS to open an IPSec VPN connection?

Consider the following situation (for test purposes): there is a public IPSec VPN endpoint (StrongSwan); a machine with either Ubuntu (Strong Swan client) or Windows OS (native client) running in the ...

1 2
3
4 5
9