I am learning about using Machine Learning for provisioning proactive resources on the Kubernetes and I have found some of the interesting articles about it on the internet(for instance for Thoth or Microscaler). I have also read about predictive autoscaling in AWS and GCP however only for VM's, not to use in the K8s clusters.

https://docs.aws.amazon.com/autoscaling/plans/userguide/how-it-works.html https://cloud.google.com/compute/docs/autoscaler/predictive-autoscaling#how_predictive_autoscaling_works

However I would like to understand more in-depth about the above solutions - how do they work internally and what is the possibility of moving that solutions to the K8s. Do You know where can I find informations about it? Or if that is even possible to find those information or they are hidden internally in those companies? Do You have any other scientific articles or solutions which are now available?


1 Answer 1


These are presumably proprietary tools for EC2 and GCE respectively. The need for predictive VM autoscaling is pretty strong for Virtual Machines since provisioning time can be measured in the 10's of minutes depending on the configuration.

Conversely, application spin-up time in Kubernetes is typically measured in seconds. Predictive scaling for the Kubernetes HPA might have limited practical benefit.

Now using cloud provider predictive autoscaling to scale out the VMs running a Kubernetes cluster based upon ML could be pretty interesting.

  • But is it possible to have VMs scale on a K8s? How does the prediction of load work in the AWS & GCP? May 26, 2021 at 6:55
  • @Ajris github.com/kubernetes/autoscaler. That scales out VMs in the cluster, however there's no prediction for the standard cluster autoscaler.
    – Jon W
    Jun 1, 2021 at 2:08
  • But it is no prediction based using any ML techniques. It's just pure verifying whether the threshold has been reached. Jun 5, 2021 at 16:52
  • Yep that's correct
    – Jon W
    Jun 28, 2021 at 17:14

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.