Questions tagged [amazon-web-services]
For questions about Amazon Web Services (AWS) in general. If your question is about a specific Amazon web service please use that tag, e.g. [amazon-s3], [amazon-ec2], [amazon-ecs], [aws-codedeploy]
543
questions
0
votes
0
answers
5
views
How can I make AWS Elastic Beanstalk logs readable?
I just deployed to AWS - Elastic Beanstalk and found the logs undreadable. These are the logs directly downloaded from Elastic Beanstalk Environment GUI.
Particularly, there is an ELB-Healthchecker ...
0
votes
2
answers
14
views
I created an Amazon EKS Kubernetes cluster using Terraform, but now I do not have access to any of the resources, and kubectl fails due to credentials
This question seeks a solution for the following errors
If you create an EKS cluster using terraform, and then use the same credentials you used to create the cluster, but see these errors, then what ...
- 141
0
votes
0
answers
13
views
Can't create EKS Node group with Terraform
I created an EKS cluster first, then create node group with Terraform.
data "aws_region" "current" {}
data "aws_iam_policy_document" "eks_worker_node_assume_role&...
- 101
0
votes
0
answers
24
views
issue when trying to use ssh-copy-id to copy your SSH public key to a remote EC2 instance
I need to use SSH-Copy-ID instead of manually copying the public key from one ec2 host instance to the remote ec2 instance. but copying key using this command always fails due to Permission denied (...
0
votes
0
answers
16
views
EKS- pod stuck in containerCreating state when attached to 2 claims with RWX accessmode and efs storage class
I have pod deployed in EKS which has 2 PVCs attached, below is yaml snipped for the same
- name: dev1-rwx-volume
persistentVolumeClaim:
claimName: dev1-rwx-volume-pvc
- name: dev2-rwx-...
- 101
1
vote
1
answer
20
views
AWS Step Function - Stop function until TaskToken is back
I have a use case where I manually trigger an AWS Step Function to migrate data between two different databases using the AWS DMS service. The Step Function execution creates a resource called ...
- 13
0
votes
1
answer
85
views
Sealed Secrets got "error: cannot fetch certificate" in Amazon EKS cluster
I am using Amazon EKS.
I can list my services by
kubectl get services -n production-sealed-secrets
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
sealed-secrets ...
- 101
0
votes
0
answers
26
views
Using IaC for docker image management/update?
I was building a simple infrastructure using terraform (for AWS), I came accross the chicken egg of Lambda functions needing an image to be created. The options I envisioned are two:
1 - I decouple ...
- 1
0
votes
0
answers
42
views
How to setup EKS ADOT for sending OpenTelemetry metrics to self managed prometheus?
I have tried to configure ADOT collector using below yaml file
apiVersion: apps/v1
kind: Deployment
metadata:
name: adot-collector
namespace: monitoring
spec:
replicas: 1
selector:
...
0
votes
0
answers
18
views
How to optimize Cloudwatch alerts firing out-of-hours?
We have a range of AWS/NatGateway alerts set up to monitor the health of our networking. When the cloudwatch alerts fire, this goes to an SNS/Lambda, which then fires a message to Slack. One of the ...
- 101
0
votes
0
answers
19
views
AWS TargetGroup running on port 80 as well as the dynamic port, how to remove port 80?
I am setting up an AWS CloudFormation stack that spins up an ECS cluster. It has an LB that routes traffic to TargetGroups on the cluster. The TaskDefinitions have HostPort:0 (dynamically assigned) ...
- 101
0
votes
0
answers
11
views
Error configuring Terraform Community Providers
I'm trying to configure a provider to create a Redshift datashare cluster, but I'm encountering some issues.
In the version file, redshift is set to required_providers,
And in the root module, I’ve ...
-1
votes
1
answer
15
views
while installing Kubernetes package related error occur, image attached how i can solve it ? (all ports are open)
Here's an inline link to install kubernetes
https://kubernetes.io/docs/setup/production-environment/tools/kubeadm/install-kubeadm/
- 1
0
votes
0
answers
20
views
AWS application load balancer not registering targets for EKS node target group
I have an EKS cluster with public/private access on a VPC with public and private subnets. I've setup my ALB in the public subnets on port 80, internet-facing and ip and installed the AWS controller ...
1
vote
1
answer
36
views
AWS CodePipeline Handling Release Candidates
We have a system set up that when we merge a branch into master, it runs in AWS CodePipeline where it recognizes the merge, builds the code to our QA environment, then waits for approval to be ...
- 111
0
votes
0
answers
104
views
Make AMD GPU available in Docker container
I am running g4ad family instances on AWS. I am running there docker containers where I need to access the AMD GPUs.
The used AMI for host instance is Amazon Linux 2 optimised for AMD.
The base image ...
0
votes
0
answers
19
views
IAM to limit RDS sharing to certain accounts
I have a multi-account AWS setup. I'm running an automatic weekly process that takes a database snapshot and shares it from Account A to Account B. For this, I'd like to ensure that the IAM role (that ...
- 1
0
votes
0
answers
41
views
Deploy a ReactJS Application to AWS EC2 Instance using AWS CodePipeline
I am trying to deploy a simple React JS app onto Ubuntu EC2 instance through AWS CodePipeline. I am using the following code in the appspec.yml file:
# This is an appspec.yml template file for use ...
- 31
0
votes
0
answers
23
views
How to test the connection from AWS to an on-premise, private API?
I have an API running in an on-premise K8s cluster.
I plan to use AWS for load balancing/access/auth/etc to expose this API to the public internet.
To forward requests from AWS to my API, I am ...
- 101
0
votes
1
answer
117
views
How to not create wildcard records using External-DNS?
I am now setting up External DNS to automate the DNS records creation on AWS Route53 for EKS Ingresses. I now have a working setup that can create and delete records depends on ingress existence. ...
2
votes
0
answers
93
views
How to deploy dockerized MERN stack app on AWS EC2 instance?
I dockerized my MERN stack app (Next js, node js, MongoDB) and tried to deploy it on the AWS EC2 instance. When I try to access my backend on port 5000 via AWS Public IP, it works fine but when I try ...
- 121
0
votes
0
answers
76
views
AWS EKS Fargate pod scheduling issue with Prometheus deployment
I'm encountering a problem with scheduling Prometheus pods on AWS EKS Fargate within my Kubernetes cluster. Here are the details of my setup:
I have configured an AWS EKS Fargate profile named ...
0
votes
0
answers
97
views
`apiVersion` is set to `v1beta1`. Still getting 'no kind "ExecCredential" is registered for version "client.authentication.k8s.io/v1alpha1"'
Despite having explicitly set apiVersion: client.authentication.k8s.io/v1beta1, why the following error when running any kubectl command (f.e. kubectl version)?
Unable to connect to the server: ...
- 121
0
votes
1
answer
30
views
EC2 can't get to internet? SG and ACL seem OK
I've applied the terraform code below (variables.tf and main.tf are, of course, separate IRL) to setup an AWS VPC, private and public subnets, routes, NAT gateway, Internet Gateway, Network ACLs, an ...
- 103
0
votes
1
answer
42
views
How to design AWS infrastructure for my online course selling website?
I am designing an AWS architecture for hosting a website that sells online courses and merchandise products. For the purpose, I am planning to use the following architecture design:
1 VPC
1 ...
- 17
0
votes
0
answers
13
views
Question about AWS Prometheus tutorial
I'm following this cool example on how to run a container and monitor it CloudWatch with Prometheus - Monitor and scale your Amazon ECS on AWS Fargate application using Prometheus metrics. All my ...
- 463
1
vote
1
answer
43
views
Worker Pool in Spacelift showing as 0 workers
I created a private worker using https://github.com/spacelift-io/terraform-aws-spacelift-workerpool-on-ec2
However, my worker pool shows as 0 even though I can see the worker in my AWS Console. What ...
1
vote
1
answer
145
views
How can I attach multiple AWS accounts to my Spacelift stack?
How can I connect my Spacelift stack to deploy resources into my multiple AWS accounts?
I have a current integration set up, and this works perfectly to deploy resources to my account but how can I ...
1
vote
2
answers
95
views
Need to understand the career path for DevOps
I am a frontend developer, planning to gain hands on experience in DevOps. However, I'm not sure of if only DevOps or DevSecOps.
Recently I tried learning Jenkins while last year took an Udemy course ...
- 17
1
vote
1
answer
1k
views
Permission Issue when creating an ECS Service with CloudFormation
I am trying to create an ECS service in a cloud formation json. Here is the role I created (I know that it has additional permissions, I am using one role for now and will break them up later)
"...
- 11
0
votes
1
answer
125
views
Terraform conditions : How to have a multiple values in case of False condition?
I need to have two urls in case if my environment is nonprod(sit,uat,dev) and my application is Techno, otherwise only one url. In order to do that, I have made every string into a list here, so that ...
- 103
0
votes
1
answer
59
views
AWS don't gather properly logs in non-blocking mode
I have faced a situation when some of the logs don't gather by awslogs driver.
Awslogs driver with mode = non-blocking and maximum buffer size = 25mb (I have experimented with these values by looking ...
- 101
0
votes
0
answers
238
views
Alternatives to 'Docker Compose's integration for ECS and ACI will be retired in November 2023'
We are currently using 'docker compose' to deploy our applications on ECS, and during its usage, we have noticed the following notice:
'Docker Compose's integration for ECS and ACI will be retired in ...
- 1
0
votes
0
answers
24
views
How to delete Kubernetes Finalisers Kubernetes.io/pv-protection?
I am trying to delete the finalisers in the PV by issuing kubectl patch command and it deletes partially leaving behind Kubernetes.io/pv-protection
Described the PVC and able to see two entries
...
0
votes
1
answer
41
views
How to ascertain excesive use of my S3 bucket?
I have a S3 bucket that I use to store images for a website I manage. The bill is usually about $1/month and I store about 12.5 GB on the service. It's never really been an issue before, but recently ...
0
votes
1
answer
35
views
EC2 instances cannot connect over Elastic IPs
I have 2 EC2 instances and I am trying to get them to connect over port 44874 (it's a layer 1 cryptocurrency like dogecoind).
Both are running Ubuntu 22.04 AMI
Both are in the same subnet
Both are in ...
- 101
1
vote
1
answer
130
views
EKS cluster upgrade from 1.23 to 1.24 ServiceUnavailableException: Updates in the cell are disabled
I've tried upgrading my EKS cluster to 1.24 and I keep getting this error: ServiceUnavailableException: Updates in the cell are disabled
I get this using the AWS console webpage here https://us-east-1....
- 143
0
votes
1
answer
177
views
What happens when you are running a "too old" version of k8s in eks?
I'm desperately trying to resolve all of our dockershim uses so we can migrate to EKS 1.24+, but I'm not optimistic I'll get it done before the "deadline".
I'm stuck on EKS 1.23 until I can ...
- 143
0
votes
2
answers
159
views
Aws EKS Prometheus helm failed pod CrashLoopBackOff with log "trigger reload: reload request failed: Post \"http://127.0.0.1:9090/-/reload\"
I followed the steps here https://docs.aws.amazon.com/prometheus/latest/userguide/AMP-onboard-ingest-metrics-new-Prometheus.html
In a nutshell, I installed the Prometheus community helm chart on my ...
- 101
0
votes
1
answer
755
views
terraform remote state bucket on s3
I want to use a remote state bucket on s3 for my terraform tfstate files (described here: https://developer.hashicorp.com/terraform/language/settings/backends/s3). It looks pretty basic, but in ...
- 103
0
votes
1
answer
335
views
How to create three different environments in AWS?
I want to deploy a public facing web project on aws, for which I have setup ec2 for front end and another ec2 for backend (leave discussion about hpa and other services etc for now). I have to ...
0
votes
1
answer
73
views
How to pass terraform locals variables into AWS resource template body
I am trying to apply aws conformance pack to my aws account using terraform. I am using the sample aws config rules in cloudformation syntax provided in the awslabs repository.
Now from an example ...
- 133
0
votes
1
answer
19
views
Why does AWS wrap roles with instance profiles?
In AWS EC2, a machine is assigned privileges using instance profiles. Specifically:
the desired permissions are articulated as an IAM policy,
that policy is attached to an IAM role,
that role is ...
- 289
0
votes
1
answer
206
views
& (ampersand) in Terraform string or/and AWS IAM policy
I coudn't find meaning of & sign in Terraform or/and AWS IAM policy. There is an example in Data Source: aws_iam_policy_document (docs) where you can see Basic Example (docs, github source):
data &...
- 123
0
votes
1
answer
615
views
"An unknown error occurred" when authenticating between GitHub Actions and AWS using OIDC
I was unable to successfully authenticate when attempting to create a GitHub Actions workflow that would authenticate with an AWS IAM Identity Provider (IdP) using Open ID Connect (OIDC), based on ...
- 111
0
votes
1
answer
142
views
Number EC2 instances required for tasks
Let's say I want to place my tasks on EC2 instances of type m6i.large, which has 2 vCPU and 8GB of memory.
I have 10 ECS tasks, each requiring 512 mCPU and 512MB of memory. How many EC2 instances do I ...
- 101
0
votes
1
answer
64
views
On AWS console, how to view ALL tags on a resource?
In the AWS console, for some resources (say for an ECR repo) there is a page for "tags". This page purports to list all tags, however it seems to list only tags without hyphens or ...
- 289
0
votes
1
answer
2k
views
Terraform - No Infrastructure Changes Detected
I have deployed a Cloudwatch Log Group community module to my terraform stack (sourced from https://github.com/cloudposse/terraform-aws-components) but I have spent more than a day trying to resolve ...
0
votes
1
answer
24
views
Cloud infrastructure term for services like AWS Sagemaker, Google Colaboratory, Microsoft Azure ML Studio
There are multiple * as a service terms in cloud computing [1, 2], e.g.
Infrastructure as a Service (IaaS)
Platform as a Service (PaaS)
Software as a Service (SaaS)
But when it comes to data-related ...
- 101
2
votes
0
answers
56
views
AWS Cloudformation - managing multiple stages versioning and deployment
I'm working on a simple cloudformation stack for a web app (some lambda functions, api gateway, cloudfront distribution, etc).
The cloudformation stack template is currently versioned on a gitlab ...
- 121