Questions tagged [autoscaling]
Autoscaling is the capability of a system to dynamically increase capacity to support higher load, and to subsequently decrease costs to reduce costs. Use this tag to describe questions that discus autoscale, plastic-scale or elastic-scale.
36 questions
-1
votes
1
answer
7
views
In kubernetes, I want to restrict my pod scheduling on worker node if memory utilisation of worker node goes above 50% of its capacity?
For eg: worker node(W) have 64GB of memory and 16vCPUs
resources assigned to a pod : cpu - 4 , memory- 8GB
Now only 4 pods can be scheduled on worker node(W).
How can i achieve this ?
Node affinity , ...
0
votes
0
answers
6
views
keda-add-ons-http-interceptor pods are in CrashLoopBackOff - not sure what is missing here [closed]
{"level":"info","ts":1733906885.9611363,"caller":"interceptor/main.go:44","msg":"starting interceptor","timeoutConfig":{&...
0
votes
0
answers
12
views
Preventing HPA Auto-Scaling during Kubernetes deployments when using custom metrics
We have an app that automatically sets up Kubernetes HPA to our customers.
We are now using metrics from Prometheus as targets to HPA. These metrics are exported from our Java applications using the ...
- 101
0
votes
0
answers
21
views
Kubernetes HPA not working with Datadog metric
I am trying to autoscale PODs based on custom metric from DatadogMetric. I have followed the documentation on Datadog to create a DatadogMetric and the use it in your HPA as External metric. My ...
0
votes
0
answers
13
views
How to Schedule a Pod in different Node in GKE
I have cluster running in gke standard mode
Here is the details
PROD Env GKE Standard Cluster running with 2 Node Pool and 9 Nodes
default-pool 1.28.3-gke.1286000 5 (1 - 2 per zone) e2-...
1
vote
3
answers
103
views
How to apply k8s manifest without scaling replicas
We have a manifest file that defines a set number of replicas and an autoscaler that scales them up. The problem we have is when we apply the manifest, it immediately scales the replicas down to the ...
- 131
0
votes
2
answers
200
views
How to add an AWS Auto Scaling Group health check on a non-web instance
Background
Adding health checks to our web ec2 instances on AWS is easy, we simply have to create an endpoint that always returns a 200 http response when it's healthy.
However, we also have other non-...
- 473
3
votes
1
answer
675
views
Do GitLab Runner worker nodes need to have network access to GitLab?
GitLab runner has an autoscale feature that allows the Runner Manager to dynamically spawn new worker nodes on demand.
The documentation says that: "GitLab Runner is going to need to talk to your ...
- 141
1
vote
1
answer
30
views
Accelerate autoscaled VM boot time
We're using Google Cloud Platform with an autoscaled pool of VM behind a google's load-balancer.
When a new VM is created in the pool it starts from a template then executes a startup-script. The ...
- 11
0
votes
1
answer
973
views
how to set automatic git pull from bitbucket and complie project on ec2 instance create event with auto scaling
I have just started reading about AWS services. I have a project where the backend is created with Spring-Boot, front-end is created with React and PostgreSQL is used as database. Both backend and ...
0
votes
2
answers
49
views
Can large scale services use a public cloud managed database service?
Theoretical question:
Is it possible for a very large scale service to use a major public cloud managed database service?
For example, a service with a scale of Netflix and a service like Amazon ...
- 27
0
votes
2
answers
141
views
When do I scale services on Azure DevOps?
I have created azure devops with a few organizations/projects in it. Do I need to scale or replicate it across different datacenters so all the developers across the globe can access it? When would I ...
- 29
1
vote
2
answers
561
views
Spread pods over cluster
Current using AWS's auto-scale policy to start EKS worker nodes (min+desired 10, max 15) on a fixed time every day. There are 120 pods and 30 deployments.
Obviously, only one node will be up firstly. ...
- 189
1
vote
1
answer
48
views
Are there serious problems with an EC2 auto-scaling AMI that automatically downloads newest server from git?
I'm converting some servers from manual scaling (with a load balancer) to auto-scaling. I'm currently using an Ansible script to manage upgrades, and I wouldn't want an automatically created instance ...
- 171
2
votes
2
answers
138
views
Terminate single processing server based on SQS queue condition, but keep/ reinstate autoscaling size at 1
I have a processing server that processes requests in an SQS queue, only about 10 per day, each taking around 2 minutes to process.
Sometimes the process gets "stuck" and it would be ideal to ...
- 650
4
votes
1
answer
93
views
What are best practices for over-committing resources in a staging environment?
Suppose there is a staging environment very strapped for resources as new development, data workloads and other applications grow. Ideally one would like to maintain production parity, even at the ...
user20119
2
votes
1
answer
2k
views
private subnets in an Auto Scaling Group on aws?
I watched a video series wherein the author used 3 private subnets for his Auto Scaling Group, and I also read the premium answer on this forum wherein the author says that you can use both public and ...
- 227
1
vote
2
answers
1k
views
Cloudformation issue with target groups and ASG
I am trying to use cloudformation to setup a ASG and I have a target group which I would like to associate with the ASG. The target group is created okay but when I go to attach it to the ASG I get an ...
- 465
1
vote
1
answer
269
views
Aws autoscaling group in private subnet, private communication?
I have a scenario -
I have configured my frontend application in one autoscaling group and my backend application is in another autoscaling group. I'm using the load balancer also. But I don't want ...
- 121
1
vote
1
answer
44
views
Do I need an orchestration tool to autoscale/scale on demand my web service?
I have a stateless web service running in a Docker container. The web service is single threaded.
We would like to span new instances of the service when the load reaches a given threshold. Is that a ...
- 1,640
0
votes
3
answers
90
views
Auto-scaling, how to securely get code from private repo
I want to setup an auto-scaling configuration but cannot think how I can securely get code from a private repo when I spin up new instances.
I obviously don't want to put passwords in startup scripts,...
- 101
4
votes
1
answer
911
views
Kubernetes auto scaling in cloud environment
Anyone knows if there is a solution to provision (non-managed) autoscaling Kubernetes clusters in the cloud?
I am looking for a generic solution that will work in any public cloud and in private data ...
- 9,003
2
votes
1
answer
608
views
Autoscaling with Kubernetes daemonset
I have a Kubernetes cluster running on Google Compute Engine. My program uses stateful connections, so I do not want my pods being moved between nodes. Because of this, I am running my workload as ...
- 121
2
votes
1
answer
64
views
I have an custom AMI and want to run certain config commands at initial boot, depending on the autoscale instance that starts it. How do I do this?
I have a custom AMI that contains the dependencies for several applications.
The only difference between the applications is several configuration options that can be configured by a bash script. (i....
- 605
2
votes
1
answer
89
views
Custom Layer 4 Load Balancer
What are my best options for deploying a load balancer on AWS with the following requirments:
Add auto scaling that will start my own EC2 instances.
Deploy 3rd party SW on the load balancer.
...
- 141
0
votes
1
answer
2k
views
Suspend autoscaling processes through Cloudformation template
I have the following autoscaling as a Cloudformation template :
MyAutoScalingGroup:
Type: AWS::AutoScaling::AutoScalingGroup
Properties:
DesiredCapacity: 1
MinSize: 1
...
- 271
6
votes
3
answers
236
views
Autoscaling on GoCD agents without terminating active builds?
At the moment I have an AutoScaling Group (ASG) of GoCD build agents without any scaling policies. I have created some custom metrics that indicate how many build agents are currently idle and I'd ...
- 1,405
8
votes
2
answers
1k
views
How to run database migrations in an auto-scaled group
We are just about to move from a monolithic architecture to an auto-scaled group and I'm not sure how I should be running my database migrations (Laravel).
I am thinking that a script will run when a ...
- 221
4
votes
2
answers
2k
views
Where to start? Scaling PHP applications on AWS
Currently all of our PHP (Laravel) applications are running on one EC2 instance. To deploy code, we SSH onto the live box and pull from CodeCommit.
We now need to scale and deploy properly.
I'm not ...
- 221
3
votes
1
answer
148
views
Are distributed distributions like NixOS able to replace docker in terms of autoscaling?
Autoscaling means that the number of instances increases if the load intensifies. Docker is used in for example Kubernetes in order to autoscale. Are distributed distributions like NixOS suitable ...
- 13.3k
3
votes
1
answer
38
views
What is the ec2 cli command to modify the minimum number of nodes in a scaling group?
I've got an ec2 autoscaling group that starts in the morning and finishes in the evening. I'd like to create a 'button' that people can click to warm up the autoscaling group to run jobs in the middle ...
- 1,153
6
votes
1
answer
656
views
Does the "cattle not pets" distinction apply as equally to machine instances as to containers?
There is a great discussion of the Cattle vs Pets distinction from Randy Bias here. Martin Fowler talks about a SnowFlakeServer.
In a series of talks, Adrian Cockcroft talks about how they moved ...
- 1,153
6
votes
2
answers
86
views
Autoscaling containers using local request counters
Somewhere around I got to know about different approaches which were used to scale our webapp which included Scaling using local request counters. Below that they had written the drawbacks of this ...
- 257
7
votes
1
answer
3k
views
How can I autoscale instances based on Kafka topic lag?
I have autoscaling groups that I want to dynamically scale up/down based on the amount of lag showing in certain Kafka topics. There's a 1:1 relationship between topic and autoscaling group that needs ...
- 183
8
votes
1
answer
2k
views
How to manage Consul and its quorum in auto-scaling environments?
We have auto-scaling Docker environments in which we use Consul for service discovery. These environments can add or remove one instance every few minutes.
Our early Consul testing showed that it was ...
- 1,965
9
votes
1
answer
763
views
How can I manage changes in desired capacity due to scaling policies in AutoScaling Group state?
How can I manage changes in desired capacity due to scaling policies in AutoScaling Group state in terraform?
Specifically, suppose I provision an aws_autoscaling_group resource with terraform with a ...
- 1,494