Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

Filter by
Sorted by
Tagged with
1
vote
1answer
551 views

User data in original windows ec2 instance does not get executed in custom ami

I created a windows Ec2 instance with user data in it. In my ec2 instance I downlaoded git and installed it. Later in EC2 instance, I provided it with the user data which was supposed to download a ...
1
vote
1answer
722 views

RDS DB migrations using ECS and Fargate

I run my app with Docker and ECS. How can I handle database migrations? With fargate there doesn’t seem to be a way to SSH into the container to run any commands so I can’t run my RDS MySQL migrations ...
2
votes
1answer
1k views

CodeDeploy: deployment failed because a specified file already exists at this location

I build an AMI from a 'prototype' EC2 instance I created to confirm everything is working. I create a Launch Configuration and Auto Scaling Group based on the AMI. I associate the Auto Scaling Group ...
1
vote
2answers
91 views

Cloud service for Django app deployment

We are having webapp which is use Django and Mysql which run in Windows using Apache. Now we are planing to move into cloud service like 1) Google cloud 2) AWS 3) Azure So to deploy existing ...
0
votes
1answer
97 views

AWS MSK: deploying all Kafka brokers in the same availability zone

When using AWS MSK, is it possible to deploy Kafka brokers in the same AWS availability zone? From what I read, AWS enforces deployments across availability zones. If you use three brokers, it will ...
0
votes
1answer
26 views

User Data in launch configuration of amazon web services

I was trying to create an EBS volume by writing a shell script in the user data of my launch configuration. I don't think there is anything wrong with my bash script. I kept looking up creating launch ...
0
votes
1answer
35 views

Unable to connect to remote service using AWS VPC Peering

I have a question regarding some AWS infra I'm trying to build. Due to legacy constraints, I have a service running in a remote VPC that I need to access, and I have a new service I'm developing in ...
1
vote
2answers
527 views

s3fs to mount S3 bucket with iamrole on non-aws machine

I am trying to mount S3 bucket on my on-premises CentOS-6 server using s3fs as below: [roots@myhost ~]# s3fs bucket-name /mnt/s3mnt -o uid=1001,gid=1001,allow_other,umask=022,iam_role=iam-role,...
1
vote
2answers
645 views

Load Balancer and EC2 in same subnet?

I have a custom VPC with 3 public subnets and 3 private subnets. I have three ec2 instances with elastic IP addresses in the public subnets taking traffic on port 80 (security group is configured to ...
4
votes
1answer
2k views

Running a command as a specific user on an ec2 using ssm

Background I want to automatically configure an EC2 via a build, using the aws cli and ssm. The (manual) setup for the container looks something like this: Create an EC2 Run a shell script as root ...
1
vote
1answer
36 views

Spin up an EC2 instance from within the application

I am developing the architecture of this application and the way we need to scale is not just stateless API requests, but it's a logical split of responsibilities. In other words, we may only be able ...
2
votes
3answers
95 views

What makes a difference between high-cost cloud providers and low-cost ones?

I need to decide, for a small client and a small budget (around $500 a month) the proper Cloud Provider to have some compute instances to hold a web server, a database and an Apache server. I was ...
0
votes
1answer
930 views

SQS: What could high number of visible messages mean if messages received & deleted are normal?

I'm new to SQS. I recently noticed the ApproximateNumberOfMessagesVisible in my SQS queue started rising. What was interesting though is that there was no sudden surge in the number of messages ...
1
vote
0answers
44 views

Is anybody using Amazon Kinesis in production, what are the experiences and what was the rationale for choosing this service?

Amazon Kinesis could be used to analyze streaming data. I wonder whether anybody is using this service and what are the experiences? After reading this documentation I have no idea for what purposes ...
2
votes
0answers
56 views

Issue with Spinnaker automated trigger

I am trying to get Spinnaker to have a pipeline use an automated trigger which is an image pushed to an ECR repo. I can add different repos fine but can't seem to see the images. I am following this ...
1
vote
1answer
30 views

How to grant all resources in an AWS account the ability to assume role?

I have an organization with a master account (account A) and a second account (account B). I want to create a role so all instances in account B will have read permission from everything in account A. ...
0
votes
2answers
549 views

AWS permissions for Fargate and SSM

I'm trying to create some infrastructure for a service I am building on AWS using AWS Fargate. I'm using SSM as a value store for some of my application configuration, so I need both the regular ...
2
votes
0answers
446 views

Allowing all apps/users access to folder - S3FS-FUSE

I'm running an application on AWS EC2 Ubuntu instance, here's what I've done: - I've mounted S3 bucket as folder with s3fs-fuse using this command (unfortunately as root : sudo): sudo s3fs ...
4
votes
1answer
2k views

parameter-store values show '***' instead of actual value

I am using CodeBuild to access the Systems Manager Parameter Store. In buildspec.yml, I have the parameter-store configured to access some values in Systems Manager (I certainly have the /mysite/dev/...
2
votes
1answer
812 views

Use dynamic values for parameter-store in aws buildspec.yml for CodeBuild

For my CodeBuild projects, I have a dev, staging and production project. Each project has an environment variable called $BUILD_ENVIRONMENT set to dev, staging and production, respectively. Each stage ...
0
votes
2answers
138 views

AWS ECR start uploaded docker image?

I used packer to upload a docker image I created to my AWS ECR repository. How can I use the AWS cli to automatically locate that image, create a new cluster, set the port rules to allow all inbound ...
1
vote
1answer
37 views

Relation/interplay of deployment pipeline stages (dev-stage-prod) with blue/green deployment mechanisms?

I'm building some new infrastructure in AWS and plan on having separate accounts for dev, stage, and prod environments. I'd like to implement a blue/green deployment strategy at least for production, ...
1
vote
1answer
416 views

private subnets in an Auto Scaling Group on aws?

I watched a video series wherein the author used 3 private subnets for his Auto Scaling Group, and I also read the premium answer on this forum wherein the author says that you can use both public and ...
1
vote
0answers
250 views

Why does an 'InvalidSnapshot.NotFound' occur in Packer and how to solve it? [closed]

When I'm running sudo packer2 build -debug template.json with this code: { "variables": { "profile": "aws", "region": "eu-west-1" }, "builders": [{ "type": "amazon-chroot", "profile": "{{...
1
vote
1answer
21 views

How to ensure EC2's OS/application is loaded?

Recently I was playing around a bit with AWS as a part of a course that I am doing. I came across a situation that to be honest is keeping be in vilo. I made a web application which connects to a ...
2
votes
1answer
62 views

Having some trouble getting service running with Docker and Terraform

I'm very new to DevOps but I'm trying to learn some of it a bit. I'm working with Terraform, trying to get a service to run on AWS using Fargate and Docker. I've successfully set up my ECR ...
1
vote
0answers
40 views

EBS Cross Region Scheduled Snapshots [closed]

I'm looking into creating scheduled EBS snapshots. I'd prefer sticking to services provided by AWS, but open to using custom scripts if the first cannot satisfy my requirements. As the title ...
2
votes
1answer
145 views

Mitigate false positives due to daylight saving time in CloudWatch anomaly dectector

For monitoring, I set up CloudWatch alerts based on CloudWatch anomaly detection. Overall, they work quite nicely, but they got confused when the clock gets shifted (summer timer to winter time). We ...
0
votes
2answers
417 views

AWS-CLI : to download IAM user with policy

aws : A single command(aws-cli) to get the IAM user name with the what all permission he/she have , would be great if can be downloaded as an excel or csv ?
1
vote
1answer
38 views

Issue connecting to ECR using Spinnaker on Kubernetes

I installed Spinnaker onto a Kubernetes cluster via Helm. I have tried to add the ECR registry as per the docs and so far not working. I found that the aws cli is missing even though in issue 2394 it ...
5
votes
1answer
360 views

AWS SQS - use case for "short polling"

When using event driven processing of work with AWS SQS and worker clients. the use of long polling is often recommended. AWS documents this here Essentially when there are no message in the queue, ...
1
vote
2answers
1k views

Unable to get Helm to work with ECR

I'm using Helm v3 with AWS ECR on a Kubernetes cluster that was creating using Kops. I have checked and the role kops assigned to the nodes does have ECR permissions. When I deploy my helm chart I ...
2
votes
1answer
558 views

For storing avatars in s3, which approach has the lowest cost?

On my site I have the ability for users to upload avatars (which they upload to s3). They can only have one avatar at the moment, so I currently just have the filename set to their user id. However, ...
1
vote
1answer
495 views

Can Jenkins master connect to a slave node in a private subnet?

We've got a Linux Jenkins master node set up in AWS behind a load balancer and I'm attempting to connect to Windows slave nodes in private subnets. Is this possible? The Jenkins URL is accessible ...
1
vote
1answer
2k views

Terraform creating single SG but multiple CIDR blocks

I am trying to use Terraform to create a single security group that will allow traffic for mongo on port 27017 from all my private subnets that are stored in a variable. My issue is I am unsure how ...
1
vote
2answers
139 views

Given a blank slate, tool recommendations? [closed]

so I have 8 months of DevOps experience previously working as a desktop engineer for two and a half years.Starting a new role in the education sector, recently they brought their IT department which ...
0
votes
1answer
70 views

DC Jenkins server to AWS servers connection

We are trying to automate the deployment process for our application, our application has two components (one hosted on DC, one hosted on AWS). Now, we are not sure how do we connect the jenkins from ...
0
votes
1answer
467 views

S3 bucket policy errors

I have the following bucket policy for Amazon S3, which is giving the following error: Error: Invalid bucket policy syntax. Either it is a JSON syntax error or a Policy error. This is the policy ...
2
votes
1answer
41 views

AWS CodePipeline frozen on Source

I have created a very simple pipeline. I have a git repo in CodeCommit, and the pipeline, when triggered, simply copies the files to an existing S3 folder which is set up to serve a static website. ...
1
vote
1answer
551 views

How to setup Cloudfront for Load balancer for a private staging domain name?

I've got a domain name foobar-staging.com, that I use for the staging environment to get feedback, testing or demo before releasing to production. Recently, decided to deploy the UI static files to s3 ...
2
votes
1answer
48 views

What is the difference between EKS and EC2 installed kubernets?

I'm newbie in AWS usage. I don't understand the difference between EKS and EC2 installed kubernets? Amazon EKS makes it easy for you to run Kubernetes on AWS without needing to install and ...
2
votes
1answer
234 views

Accessing AWS Secrets Manager from Docker

All the tutorials I've seen for AWS Secrets Manager have secrets being retrieved by the CLI. How is this done in production? Can I mount a set of secrets to a docker container as a file?
1
vote
1answer
47 views

How to share RDS snapshots across account roles?

I'm using an AWS account which has different roles for the different environments we use. For example, we have a Development role for our development environment and a Production role for our ...
0
votes
1answer
1k views

Cloudformation YAML not well-formed

I have a cloud formation template that I want to import some values from another template. Currently the other template exports a string by joining together an array (better way of doing this?). In ...
1
vote
1answer
555 views

How can I enable active tracing by default for an AWS Lambda function using Terraform?

On the console, there’s the option to enable active tracking for X-ray tracking but I can see this in the Terraform aws_lambda_function resource the aws_xray_sampling_rule resources? I'm currently ...
2
votes
1answer
100 views

Container for every user

Please help me here based on your experiences. We have launched a desktop application where users can download all their online data from several platforms at one place. Our motto is to provide users ...
1
vote
1answer
34 views

Is it possible to read secured keys from aws-secrets-manager without using aws access and secret key?

I've created a local development environment for new developers coming to work in the company I work for. One of the microservices running as part of this local development environment requires ...
3
votes
1answer
29 views

Provisioning a server on behalf of a user on GCP/AWS/Azure and probably relinquish access

I'd like to build a service where I run a custom setup script on behalf of a user on an t2.micro equivalent instance but be able to probably relinquish access to the server. Any advice on the tech ...
0
votes
1answer
122 views

How to setup a permanent storage volume for EC2 instance?

I created an EC2 instance of r5ad.xlarge and installed Jenkins on it. However, after a few jobs I configured and ran I saw a warning about no space left. Then realised Jenkins was installed on 8 GB ...
0
votes
1answer
62 views

Route53 DNS records stopped resolving

Last week, my TXT and other DNS records on Route53 stopped resolving: https://dnschecker.org/#TXT/thuijls.net The entries are set like: What else could be missing here? As far as I'm aware, nothing ...

1 2 3
4
5
9