Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

Filter by
Sorted by
Tagged with
0
votes
0answers
7 views

How to set delimiter in AWS Athena & Glue CSV Serde format

The data I export to S3 from an application is in CSV format. The headers in the CSV file has curly braces ({name}) around them. Other than the headers the data looks fine no need of any delimiters. ...
0
votes
0answers
9 views

EC2 Image builder power shell execution arguments ineffective

I am trying to create a Windows C++ Ci build machine image using EC2 image builder. In order to install the needed MSVC compiler, I use the Visual Studio build tools bootstraper to install it ...
2
votes
1answer
21 views

AWS Credentials - What are multi region user/role management best practices?

In the past, I've usually had separate accounts for each region that I've worked in. These accounts had different IAM roles/etc, so there was very little chance I'd inadvertently mess up region A ...
0
votes
1answer
19 views

Is there a way through which I can control type of load balancer like round robin , least-connections etc using helm charts?

I am researching different types of loadbalancing methods available through kubernetes .I want to implement & see before deciding on one .I'm stuck at how to actually define typeof-loadbalancer.If ...
0
votes
0answers
16 views

Terraform | Auto-scaling elasticache_replication_group Redis on AWS

Wanted to ask a question regarding auto-scaling of the redis replication_group I created using terraform. The situation is that I am provisioning a new redis cluster using terraform. But as the ...
0
votes
0answers
7 views

Can you connect directly out from one port to a different port between 2 resources in an AWS environment?

Can you say go out from port 80 to port 3000 with aws handling the port forwarding?
1
vote
0answers
7 views

How to enable anonymous authentication for kube-apiserver using kops on AWS C2?

I want to enable anonymous authentication using kops, but it's default settings provides the --anonymous-auth=false options to kube-apiserver: /usr/local/bin/kube-apiserver --allow-privileged=true --...
1
vote
1answer
35 views

Terraform error Reference to “count” in non-counted context for resources not necessarily data

here's my part of my code that I am having issues with. Unfortunately I could not understand the relationship between the last answer, despite being almost what I need, and my situation. data "...
1
vote
2answers
21 views

Terraform - how to modify a existing S3 bucket that was created from module?

I already have my S3 bucket called foo-name created and existing with terraform. I want to modify the existing s3 bucket and a policy. But when I do this it seems to want to add a new s3 bucket ...
1
vote
1answer
23 views

How to deploy a Kubernetes service using NodePort on AWS?

I have created a cluster on AWS EC2 using kops consisting of a master node and two worker nodes, all with public IPv4 assigned. Now, I want to create a deployment with a service using NodePort to ...
0
votes
0answers
12 views

Microsoft.Data.Tools.Schema.SqlTasks.targets missing in AWS Code Build

I am stuck with the process of CI for Database (MS SQLServer). I am using AWS DevOps Services(Code commit, build, deploy) to do CI/CD process of our projects, and I have successfully done that on ...
3
votes
1answer
29 views

Should AWS arn values be treated as secrets?

I have a configuration file that contains AWS resource arn's stored in a Github repo. This includes some arn's of AWS IAM role resources. Should these be treated as if they are a secret value, and not ...
0
votes
0answers
10 views

Jenkins Extensible Choice using system groovy Choice parameter to get ec2 instance not working

While I am trying to get the instance-ID list from aws account using Extensible Choice using system groovy Choice parameter it gives no error also there is no output. Below is the script that was ...
0
votes
0answers
8 views

serverless offline vs lambci - Testing environment

I want to implement in Docker a Lambda environment to test some functions. In a remote server I have a docker environment to test an app with other devs so i need to implement a docker container with ...
1
vote
0answers
32 views

Variables in Amazon S3 redirect rules

I'm trying to configure path redirect for Amazon S3 bucket static content ( → Properties → Static website hosting → Redirection rules). Simple rules, such as in instruction, work properly. Is it ...
0
votes
0answers
11 views

Connect AWS Quicksight to Heroku Postgres Database

I want to configure an Amazon Quicksight instance to use a Postgres database that is located in a Heroku Private Space. So I followed the steps on https://devcenter.heroku.com/articles/heroku-...
0
votes
0answers
11 views

How to authenticate third party webhook request in AWS Lambda serverless deployment

I'm writing a function that handles the callback of a Stripe.com checkout session. Basically, I receive some data in the body of the request, verify it with the Stripe node library, then I'm trying ...
1
vote
1answer
39 views

Terraform: can't connect to AWS provider using shared config file or static variable

I'm trying to use terraform to manage AWS resources and trying to set up the credentials configuration. I'm following the official documentation: https://www.terraform.io/docs/providers/aws/index.html ...
1
vote
0answers
12 views

Deploying several serverless (framework) services at once

I am building a data etl pipeline using AWS lambda and step functions. Each stage of the pipeline is a separate service on their own. The file structures resembles some thing like this. -root |-...
1
vote
1answer
32 views

AWS API Gateway as an http proxy to ALB

I have a setup of API Gateway proxying all the requests to my EC2 instances behind load balancer (ALB). But I want api endpoint to have a nice domain my-api.mydomain.com. I'm trying to accomplish that ...
4
votes
2answers
49 views

How to `terraform destroy` an `aws_instance` without also destroying its `aws_ebs_volume` (separate resource)

$ terraform -version Terraform v0.12.21 + provider.aws v2.34.0 Given a terraform configuration for one set of single aws_instance, aws_ebs_volume and aws_volume_attachment resources, each named, say,...
2
votes
0answers
23 views

SFTP server with third party user management system?

I understand how to set up SFTP servers on Linux and create users and their passwords manually. So basically, the users get authenticated as normal Linux users get authenticated through /etc/passwd. ...
1
vote
1answer
6 views

Unable to start step function after account move

I recently moved my development account away from my prod one, everything seemed fine except I have a service that runs a lambda to start a step function - not ideal but used to work. My issue comes ...
0
votes
0answers
14 views

Kubernetes Persistent Volume Mount Not Syncing Files

I have an AWS EFS persistent volume mounting a file at /opt/file.jar via: $ mount | grep file.jar fs-xxxxxxxx.efs.us-west-2.amazonaws.com:/pvc-12345/file.jar on /opt/file.jar type nfs4 (rw,relatime,...
1
vote
1answer
32 views

AWS launch template create-before-destory?

In terraform, to reduce downtime when creating a new auto-scaling-group behind an existing load balancer, you can use a launch configuration and set create-before-destroy. Launch templates are the ...
0
votes
0answers
14 views

Why does destroying an ASG AWS take so long?

Creating an auto-scaling-group in AWS is extremely fast in terraform. Destroying one, on the other hand, takes far longer (5+ minutes instead of 1 minute). This makes down-time fairly significant (...
-1
votes
1answer
20 views

AWS organizations and Billing

I was using an AWS account with my credit card info and my personal account. Since I'm learning my way around AWS services I am using free tier as much as I can but I still have some small charges ...
0
votes
0answers
13 views

EKS ELB unable to send/recieve options request

I have a Kuberentes cluster which is running on AWS via EKS. I have a classic LB created and the front end I use (Vue.js/ axios) sends a OPTIONS request before the POST request I belive. My issue ...
1
vote
1answer
38 views

Cloud agnostic infrastructure automation better than terraform?

Are there any infrastructure automation technologies which do a better job at being portable than terraform? We heavily leverage terraform as it is a cloud-agnostic technology (vs, say, ARM templates ...
1
vote
0answers
14 views

Backup kubernetes cluster + EBS PVs / restore to new account?

We are migrating multiple EKS kubernetes clusters to new AWS accounts, and each of them has AWS EBS persistent volumes encrypted with the default account key. Within an account we were planning on ...
0
votes
1answer
20 views

Is there a limitation in AWS to open an IPSec VPN connection?

Consider the following situation (for test purposes): there is a public IPSec VPN endpoint (StrongSwan); a machine with either Ubuntu (Strong Swan client) or Windows OS (native client) running in the ...
1
vote
1answer
33 views

User data in original windows ec2 instance does not get executed in custom ami

I created a windows Ec2 instance with user data in it. In my ec2 instance I downlaoded git and installed it. Later in EC2 instance, I provided it with the user data which was supposed to download a ...
1
vote
1answer
28 views

RDS DB migrations using ECS and Fargate

I run my app with Docker and ECS. How can I handle database migrations? With fargate there doesn’t seem to be a way to SSH into the container to run any commands so I can’t run my RDS MySQL migrations ...
0
votes
0answers
14 views

AWS Route 53 cross account resolving

I have 2 AWS accounts under my organization. In account A I have a Route 53 public hosted zone with a registered domain mydomain.com. In account B I have a load balancer I want to create a CNAME ...
0
votes
0answers
11 views

How can I get utilization and coverage reports for RDS reserved instances?

The utilization and coverage reports in Cost Explorer seem to only show data for EC2 reserved instances. The "Service" report filter defaults to "EC2-Instances" and apparently it cannot be changed. ...
0
votes
0answers
174 views

CodeDeploy: deployment failed because a specified file already exists at this location

I build an AMI from a 'prototype' EC2 instance I created to confirm everything is working. I create a Launch Configuration and Auto Scaling Group based on the AMI. I associate the Auto Scaling Group ...
0
votes
0answers
12 views

Auto-install all security updates on new eksctl nodes

When I create a new nodegroup in my cluster with eksctl create nodegroup --config-file=cf.yaml, I'd like the newly created ec2 instances to start with all available security updates installed. By ...
1
vote
2answers
34 views

Cloud service for Django app deployment

We are having webapp which is use Django and Mysql which run in Windows using Apache. Now we are planing to move into cloud service like 1) Google cloud 2) AWS 3) Azure So to deploy existing ...
0
votes
0answers
18 views

AWS MSK: deploying all Kafka brokers in the same availability zone

When using AWS MSK, is it possible to deploy Kafka brokers in the same AWS availability zone? From what I read, AWS enforces deployments across availability zones. If you use three brokers, it will ...
0
votes
1answer
15 views

User Data in launch configuration of amazon web services

I was trying to create an EBS volume by writing a shell script in the user data of my launch configuration. I don't think there is anything wrong with my bash script. I kept looking up creating launch ...
0
votes
0answers
12 views

Unable to connect to remote service using AWS VPC Peering

I have a question regarding some AWS infra I'm trying to build. Due to legacy constraints, I have a service running in a remote VPC that I need to access, and I have a new service I'm developing in ...
1
vote
1answer
32 views

s3fs to mount S3 bucket with iamrole on non-aws machine

I am trying to mount S3 bucket on my on-premises CentOS-6 server using s3fs as below: [roots@myhost ~]# s3fs bucket-name /mnt/s3mnt -o uid=1001,gid=1001,allow_other,umask=022,iam_role=iam-role,...
1
vote
0answers
67 views

AWS ECS Overwrites Docker Entrypoint Command?

So I've built a docker image locally with packer. When running the image locally, everything is fine. But for my deployment I've uploaded the docker image to the ECR and started it on ECS. However ...
1
vote
2answers
51 views

Load Balancer and EC2 in same subnet?

I have a custom VPC with 3 public subnets and 3 private subnets. I have three ec2 instances with elastic IP addresses in the public subnets taking traffic on port 80 (security group is configured to ...
1
vote
0answers
55 views

How to connect AWS LoadBalancer to EKS node group using Terraform?

I've created the following service using Terraform: resource "kubernetes_service" "example" { metadata { name = "example" labels = { app = "example" } } spec { port { ...
0
votes
0answers
73 views

Running a command as a specific user on an ec2 using ssm

Background I want to automatically configure an EC2 via a build, using the aws cli and ssm. The (manual) setup for the container looks something like this: Create an EC2 Run a shell script as root ...
1
vote
1answer
21 views

Spin up an EC2 instance from within the application

I am developing the architecture of this application and the way we need to scale is not just stateless API requests, but it's a logical split of responsibilities. In other words, we may only be able ...
2
votes
3answers
78 views

What makes a difference between high-cost cloud providers and low-cost ones?

I need to decide, for a small client and a small budget (around $500 a month) the proper Cloud Provider to have some compute instances to hold a web server, a database and an Apache server. I was ...
0
votes
1answer
65 views

SQS: What could high number of visible messages mean if messages received & deleted are normal?

I'm new to SQS. I recently noticed the ApproximateNumberOfMessagesVisible in my SQS queue started rising. What was interesting though is that there was no sudden surge in the number of messages ...
0
votes
0answers
8 views

CloudFormation - Partitioning EBS root volume

Below is the cloudformation template to create EC2 instance: "EC2Instance":{ "Type": "AWS::EC2::Instance", "Properties":{ "ImageId": "ami-07777777777c7", "InstanceType": "t2....

1
2 3 4 5
7