Questions tagged [amazon-web-services]

For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]

40 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
6
votes
0answers
797 views

Provisioning times for Redis in cloud taking too long, how can we shorten it?

Provisioning a 1 GB Redis cache service on AWS takes around 8 minutes. Doing the same on Azure takes around 16 minutes. Ours Terraform scripts need the call back from the Redis systems. Why is this ...
3
votes
0answers
26 views

What are the real world benefits of RDS instance (at rest) encryption?

AWS offers at rest encryption for its RDS instances. I think this sounds nice, and it's something that comes up regularly on security reviews but I'm not sure what the real benefit is. The most likely ...
3
votes
0answers
80 views

Is running linux container on windows aws instance possible?

what I'm trying to achieve is running a Linux(ubuntu LST) container inside a windows server 2019 OS. The problem is that the windows OS runs as an AWS instance. There have been problem for me trying ...
3
votes
0answers
907 views

Defining and using bash functions in AWS CodeBuild

I thought I could slightly improve readability of repetitive sed calls when inserting secrets into a file with AWS CodeBuild. I defined a bash function: replaceConfig() { sed -i 's|{'$1'}|'${!1}'|' ...
3
votes
0answers
127 views

How to deploy StatsD listening on UDP in kubernetes with external loadbalancer on AWS?

Our goal is to have StatsD deployed on k8s cluster running on AWS. Currently all existing applications using UDP to send StatsD metrics. As we understood from the kubernetes docs and tests we ...
2
votes
1answer
25 views

Do GitLab Runner worker nodes need to have network access to GitLab?

GitLab runner has an autoscale feature that allows the Runner Manager to dynamically spawn new worker nodes on demand. The documentation says that: "GitLab Runner is going to need to talk to your ...
2
votes
1answer
60 views

SFTP server with third party user management system?

I understand how to set up SFTP servers on Linux and create users and their passwords manually. So basically, the users get authenticated as normal Linux users get authenticated through /etc/passwd. ...
2
votes
1answer
1k views

CodeDeploy: deployment failed because a specified file already exists at this location

I build an AMI from a 'prototype' EC2 instance I created to confirm everything is working. I create a Launch Configuration and Auto Scaling Group based on the AMI. I associate the Auto Scaling Group ...
2
votes
0answers
55 views

Issue with Spinnaker automated trigger

I am trying to get Spinnaker to have a pipeline use an automated trigger which is an image pushed to an ECR repo. I can add different repos fine but can't seem to see the images. I am following this ...
2
votes
0answers
444 views

Allowing all apps/users access to folder - S3FS-FUSE

I'm running an application on AWS EC2 Ubuntu instance, here's what I've done: - I've mounted S3 bucket as folder with s3fs-fuse using this command (unfortunately as root : sudo): sudo s3fs ...
2
votes
0answers
736 views

How to deploy with AWS CodePipeline a multicontainer docker environment without dockerfile

I'm using simple docker-compose container images. Here's my docker-compose.yml version: '2' services: db: image: postgres:10.2 ports: - "5432:5432" ...
1
vote
0answers
23 views

Launching VM instances only when needed

I am looking for the right tool to launch VM instances on a cloud platform only when I need them. Once launched, they should run a containerized script (let's call it a job) that runs for about 5 to ...
1
vote
1answer
45 views

Should we deploy Storage Class Per Application OR one Storage Class for All applications?

I am using aws-ebs-csi-driver on k8s for persistent volumes. I came across a scenario where I can create ebs storage class once and then use it across all the statefulsets deployments to create ...
1
vote
0answers
22 views

Native Terraform AWS Auto-Scaling Group Management with health Checks

I have been using CloudFormation for the past 3 years to manage AWS infrastructure which consists of multiple auto-scaling groups with immutable AMIs (amongst other things). I am trying to rewrite ...
1
vote
0answers
11 views

HSM into cloud for windows authenticode signing - Cost benefits vs Security risks?

Our product has 4 apps (Windows, macOS, iOS & Android) with a partially combined build pipeline. 90% is run in the cloud (Android, iOS & macOS are built entirely on cloud infrastructure) but ...
1
vote
0answers
17 views

Cost minimization in aws parallel cluster

I'm new to aws cloud service. I have to create a parallel cluster in aws. So, I'm using aws parallel cluster. But the problem is, when creating a cluster the NAT gateway billing me when I'm not using ...
1
vote
0answers
262 views

The deployment failed because no instances were found in your green fleet

I have created a blue-green deployment in AWS CodeDeploy with the option Manually provision instances. but when I run pipeline code deploy show error `The deployment failed because no instances were ...
1
vote
1answer
211 views

In the AWS CLI how do I treat a special character as a string?

I'm trying to run an AWS CLI command for a resource with a ! in its name. I'm doing this from Centos docker instance running on my local device a MAC and if I run echo "$SHELL" it says it ...
1
vote
0answers
539 views

Ansible/AWS dynamic inventory -- How to create groups based on tags?

I am trying to create custom groups, based on tags. I am using this doc as a reference: https://docs.ansible.com/ansible/latest/plugins/inventory.html#inventory-plugins As a baseline, in my aws_ec2....
1
vote
0answers
39 views

How to use Vault generated certificates for Internal Domains in AWS

I have generated certificates for an internal domain using Hashicorp Vault. I have exported the private key, certificate body and certificate chain. I have uploaded the certificate onto AWS ...
1
vote
0answers
19 views

Allow specific AWS permissions(Lambda, S3) / roles to specific Jenkins Jobs within same AWS account

We have one AWS account in which an Ec2 instance is running where Jenkins is installed, and we have attached an IAM role to it, with s3 access permission. We have Jenkins jobs which needed aws ...
1
vote
0answers
29 views

In aws will snapshots be cheaper than AMIs?

I know you can create AMIs from a snapshot. Snapshots are cheaper to store than AMIs and that AMIs of a stopped instance are cheaper to store than an AMI of a running instance. Will an AMI of a ...
1
vote
0answers
44 views

Is anybody using Amazon Kinesis in production, what are the experiences and what was the rationale for choosing this service?

Amazon Kinesis could be used to analyze streaming data. I wonder whether anybody is using this service and what are the experiences? After reading this documentation I have no idea for what purposes ...
1
vote
0answers
372 views

Why does Jenkins' Amazon EC2 Plugin not terminate some VMs when they are idle for X minutes on AWS US-east-1?

| Product | Version | |:-----------|--------:| | EC2 plugin | X | | Jenkins | 2.190.1 | Looking for help troubleshooting an intermittent issue; We run an Ubuntu version of Jenkins on AWS ...
0
votes
0answers
6 views

How to setup JFrog remote repositories?

We use jfrog artifactory for storing binaries We use lot of third party tools like openjdk, python etc. Can we use jfrog remote repositories to safely download latest version of all these 3rd party ...
0
votes
0answers
2 views

Regional server read from nearby MongoDB cluster node and write to remote MongoDB master

We plan to set up a global MongoDB cluster across 2 different data centers. The MongoDB master will be inside the AWS China data center and there will be a read-only node in AWS Singapore. How do we ...
0
votes
0answers
33 views

Terraform/AWS Macie: how to use managed data identifiers?

I am trying to enable AWS Macie via Terraform to run scheduled jobs that scan S3 buckets for sensitive data. I've been able to create an account and execute an initial scan of my buckets, but I would ...
0
votes
0answers
24 views

Terraform cannot destroy with EBS volume attached

to detach from Instance (): unexpected state 'busy', wanted target 'detached'. last error: %!s(<nil>) I get the above error when I try to run terraform destroy. I think the ebs volume must be ...
0
votes
0answers
25 views

Gitlab (self hosted gitlab) pipeline fail when trying to fetch repository

I've setup own gitlab server on AWS EC2 Instance based on this image - https://aws.amazon.com/marketplace/pp/prodview-w6ykryurkesjq?ref_=aws-mp-console-subscription-detail and assign Elastic IP for ...
0
votes
0answers
24 views

Can an autoscaling group use both target tracking and scheduled policies?

I have an ECS cluster I'm deploying Docker images to using Fargate as the runtime. The containers run a process that consumes from a message broker queue. We'd like to define an autoscaling group that ...
0
votes
0answers
16 views

Connect Docker Swarm to AWS Application Load Balancer

What is the best practice to connect a Docker Swarm that is deployed in EC2 with an Application Load Balancer? In my configuration the ALB is what Route53 resolves to. The Docker Swarm is configured ...
0
votes
0answers
6 views

Manually delete OpenShift cluster; terraform files missing

I have an IPI installed OpenShift cluster in AWS, but I have somehow lost the terraform files associated with that install. I can't run openshift-install destroy cluster without them. How would I best ...
0
votes
0answers
8 views

How to breakout Redshift query duration by each individual query in DataDog?

I am currently working on building a monitoring and alerting system for our infrastructure in DataDog. I made a time series widget showing query duration (aws.redshift.query_duration) filtered to the ...
0
votes
1answer
37 views

AWS FARGATE ECS - Exact steps to deploy new Docker images with aws CLI

We run services in AWS FARGATE... our Docker builds are tagged before we push them to AWS with a Makefile. I committed changes to a Docker service, ran make, and I see the new Docker image tag when I ...
0
votes
0answers
3 views

What are some techniques to better maintain a Redshift cluster

We currently have an issue with our Redshift cluster in the sense that we're constantly always running out of space (we have to buy a new node every couple weeks) and query speeds for the same queries ...
0
votes
0answers
15 views

How to limit access to internal AWS instances by other services and developers?

I have a dozen instances and lambdas, most of which are not publicly accessible. There are several dozen developers. Everything is currently managed by terraform. I would like to restrict access to ...
0
votes
0answers
59 views

Notify users on failed AWS cognito login and block on multiple failed login

I am looking for the steps to block cognito user after multiple failed login (eg. 3 failed login) and notify via email for each failed login with some details like location or IP of login device. Got ...
0
votes
0answers
12 views

Redirect traffic to a ALB from AWS VPN endpoint client

I have an internet-facing load balancer, this ALB points to machines with private IP. On the other hand, I have an AWS VPN endpoint, I downloaded the config file, and most importantly I can ssh into ...
0
votes
1answer
165 views

Export CloudFormation file from CDK

Since I've seen Hashicorp Terraform, I have been wondering why the "plan" it can export has binary format. Now in the AWS world you have got a declarative configuration language called ...
0
votes
0answers
935 views

SQS Error Message: The specified queue does not exist for this wsdl version

I have a Lambda function that is created inside a serverless framework setup. I am trying to pass in a queue url as an ENV variable, when I do that it results in the below error message. I've checked ...