Questions tagged [autoscaling]
Autoscaling is the capability of a system to dynamically increase capacity to support higher load, and to subsequently decrease costs to reduce costs. Use this tag to describe questions that discus autoscale, plastic-scale or elastic-scale.
38
questions
0
votes
0
answers
10
views
Transfer multidomain PHP application to AWS Autoscaling
We have a bunch of websites (>15) running on the same codebase. Currently our strategy is to run every website on a separate Lightsail/EC2 instance. Website behavior depends on .env file but it is ...
- 1
0
votes
0
answers
20
views
How to auto-scale a web application in Kubernetes without overprovisioning?
Consider a traditional web application.
Under no load, the application does not require or utilize too many resources. The CPU usage grows linearly with the number of users/requests per second.
If I ...
1
vote
1
answer
78
views
How to apply k8s manifest without scaling replicas
We have a manifest file that defines a set number of replicas and an autoscaler that scales them up. The problem we have is when we apply the manifest, it immediately scales the replicas down to the ...
- 131
1
vote
0
answers
25
views
Kubernetes Vetical Pod Autoscaler wont recreate pods
I'm running the Kubernetes VPA on a GKE project. It has Vertical Pod Autoscaling enabled and I've run the vpa-up.sh script from their Github VPA.
Furthermore, the pods running are JupyterHub notebook ...
- 11
0
votes
2
answers
133
views
How to add an AWS Auto Scaling Group health check on a non-web instance
Background
Adding health checks to our web ec2 instances on AWS is easy, we simply have to create an endpoint that always returns a 200 http response when it's healthy.
However, we also have other non-...
- 473
1
vote
0
answers
285
views
Why is hpa scaling in the wrong direction?
I have two Horizontal Pod Autoscalers, for different deployments with identical metric value and target, and they are scaling in opposite directions. The condition of one ("dev") is ...
- 269
3
votes
1
answer
583
views
Do GitLab Runner worker nodes need to have network access to GitLab?
GitLab runner has an autoscale feature that allows the Runner Manager to dynamically spawn new worker nodes on demand.
The documentation says that: "GitLab Runner is going to need to talk to your ...
- 141
1
vote
1
answer
28
views
Accelerate autoscaled VM boot time
We're using Google Cloud Platform with an autoscaled pool of VM behind a google's load-balancer.
When a new VM is created in the pool it starts from a template then executes a startup-script. The ...
- 11
1
vote
0
answers
68
views
Native Terraform AWS Auto-Scaling Group Management with health Checks
I have been using CloudFormation for the past 3 years to manage AWS infrastructure which consists of multiple auto-scaling groups with immutable AMIs (amongst other things). I am trying to rewrite ...
- 11
0
votes
1
answer
828
views
how to set automatic git pull from bitbucket and complie project on ec2 instance create event with auto scaling
I have just started reading about AWS services. I have a project where the backend is created with Spring-Boot, front-end is created with React and PostgreSQL is used as database. Both backend and ...
0
votes
2
answers
49
views
Can large scale services use a public cloud managed database service?
Theoretical question:
Is it possible for a very large scale service to use a major public cloud managed database service?
For example, a service with a scale of Netflix and a service like Amazon ...
- 27
0
votes
3
answers
127
views
When do I scale services on Azure DevOps?
I have created azure devops with a few organizations/projects in it. Do I need to scale or replicate it across different datacenters so all the developers across the globe can access it? When would I ...
- 19
1
vote
2
answers
548
views
Spread pods over cluster
Current using AWS's auto-scale policy to start EKS worker nodes (min+desired 10, max 15) on a fixed time every day. There are 120 pods and 30 deployments.
Obviously, only one node will be up firstly. ...
- 189
1
vote
1
answer
37
views
Are there serious problems with an EC2 auto-scaling AMI that automatically downloads newest server from git?
I'm converting some servers from manual scaling (with a load balancer) to auto-scaling. I'm currently using an Ansible script to manage upgrades, and I wouldn't want an automatically created instance ...
- 161
2
votes
2
answers
100
views
Terminate single processing server based on SQS queue condition, but keep/ reinstate autoscaling size at 1
I have a processing server that processes requests in an SQS queue, only about 10 per day, each taking around 2 minutes to process.
Sometimes the process gets "stuck" and it would be ideal to ...
- 650
4
votes
1
answer
74
views
What are best practices for over-committing resources in a staging environment?
Suppose there is a staging environment very strapped for resources as new development, data workloads and other applications grow. Ideally one would like to maintain production parity, even at the ...
user20119
1
vote
1
answer
2k
views
private subnets in an Auto Scaling Group on aws?
I watched a video series wherein the author used 3 private subnets for his Auto Scaling Group, and I also read the premium answer on this forum wherein the author says that you can use both public and ...
- 217
1
vote
2
answers
1k
views
Cloudformation issue with target groups and ASG
I am trying to use cloudformation to setup a ASG and I have a target group which I would like to associate with the ASG. The target group is created okay but when I go to attach it to the ASG I get an ...
- 465
1
vote
0
answers
54
views
What is the Young's Modulus for EC2? [closed]
Young's Modulus is defined as follows:
Young's modulus or Young modulus is a mechanical property that measures the stiffness of a solid material
In the case of AWS Elastic Compute Cloud (EC2), the ...
- 3,570
1
vote
1
answer
223
views
Aws autoscaling group in private subnet, private communication?
I have a scenario -
I have configured my frontend application in one autoscaling group and my backend application is in another autoscaling group. I'm using the load balancer also. But I don't want ...
- 121
1
vote
0
answers
38
views
kubernetes - load balancing where ressources are available [closed]
I would like to know how could I set up a load balancer at the Kubernetes level so my services point to the pods that have more RAM/CPU resources available, and not randomly.
It would be co-existing ...
- 75
1
vote
1
answer
42
views
Do I need an orchestration tool to autoscale/scale on demand my web service?
I have a stateless web service running in a Docker container. The web service is single threaded.
We would like to span new instances of the service when the load reaches a given threshold. Is that a ...
- 1,500
0
votes
3
answers
58
views
Auto-scaling, how to securely get code from private repo
I want to setup an auto-scaling configuration but cannot think how I can securely get code from a private repo when I spin up new instances.
I obviously don't want to put passwords in startup scripts,...
- 101
4
votes
1
answer
871
views
Kubernetes auto scaling in cloud environment
Anyone knows if there is a solution to provision (non-managed) autoscaling Kubernetes clusters in the cloud?
I am looking for a generic solution that will work in any public cloud and in private data ...
- 8,963
2
votes
1
answer
552
views
Autoscaling with Kubernetes daemonset
I have a Kubernetes cluster running on Google Compute Engine. My program uses stateful connections, so I do not want my pods being moved between nodes. Because of this, I am running my workload as ...
- 121
2
votes
1
answer
53
views
I have an custom AMI and want to run certain config commands at initial boot, depending on the autoscale instance that starts it. How do I do this?
I have a custom AMI that contains the dependencies for several applications.
The only difference between the applications is several configuration options that can be configured by a bash script. (i....
- 605
2
votes
1
answer
77
views
Custom Layer 4 Load Balancer
What are my best options for deploying a load balancer on AWS with the following requirments:
Add auto scaling that will start my own EC2 instances.
Deploy 3rd party SW on the load balancer.
...
- 141
0
votes
1
answer
2k
views
Suspend autoscaling processes through Cloudformation template
I have the following autoscaling as a Cloudformation template :
MyAutoScalingGroup:
Type: AWS::AutoScaling::AutoScalingGroup
Properties:
DesiredCapacity: 1
MinSize: 1
...
- 271
6
votes
3
answers
214
views
Autoscaling on GoCD agents without terminating active builds?
At the moment I have an AutoScaling Group (ASG) of GoCD build agents without any scaling policies. I have created some custom metrics that indicate how many build agents are currently idle and I'd ...
- 1,395
8
votes
2
answers
1k
views
How to run database migrations in an auto-scaled group
We are just about to move from a monolithic architecture to an auto-scaled group and I'm not sure how I should be running my database migrations (Laravel).
I am thinking that a script will run when a ...
- 221
4
votes
2
answers
2k
views
Where to start? Scaling PHP applications on AWS
Currently all of our PHP (Laravel) applications are running on one EC2 instance. To deploy code, we SSH onto the live box and pull from CodeCommit.
We now need to scale and deploy properly.
I'm not ...
- 221
3
votes
1
answer
142
views
Are distributed distributions like NixOS able to replace docker in terms of autoscaling?
Autoscaling means that the number of instances increases if the load intensifies. Docker is used in for example Kubernetes in order to autoscale. Are distributed distributions like NixOS suitable ...
- 13.1k
3
votes
1
answer
34
views
What is the ec2 cli command to modify the minimum number of nodes in a scaling group?
I've got an ec2 autoscaling group that starts in the morning and finishes in the evening. I'd like to create a 'button' that people can click to warm up the autoscaling group to run jobs in the middle ...
- 1,133
6
votes
1
answer
555
views
Does the "cattle not pets" distinction apply as equally to machine instances as to containers?
There is a great discussion of the Cattle vs Pets distinction from Randy Bias here. Martin Fowler talks about a SnowFlakeServer.
In a series of talks, Adrian Cockcroft talks about how they moved ...
- 1,133
6
votes
2
answers
84
views
Autoscaling containers using local request counters
Somewhere around I got to know about different approaches which were used to scale our webapp which included Scaling using local request counters. Below that they had written the drawbacks of this ...
- 257
7
votes
1
answer
3k
views
How can I autoscale instances based on Kafka topic lag?
I have autoscaling groups that I want to dynamically scale up/down based on the amount of lag showing in certain Kafka topics. There's a 1:1 relationship between topic and autoscaling group that needs ...
- 183
8
votes
1
answer
2k
views
How to manage Consul and its quorum in auto-scaling environments?
We have auto-scaling Docker environments in which we use Consul for service discovery. These environments can add or remove one instance every few minutes.
Our early Consul testing showed that it was ...
- 1,955
9
votes
1
answer
728
views
How can I manage changes in desired capacity due to scaling policies in AutoScaling Group state?
How can I manage changes in desired capacity due to scaling policies in AutoScaling Group state in terraform?
Specifically, suppose I provision an aws_autoscaling_group resource with terraform with a ...
- 1,484