3

We're running like 100+ servers on AWS EC2 with like 20 microservices all load balanced and autoscaled with 2 to 3 instances.

The cost has become....very significant.

I'm wondering if migrating these to Kubernetes or ECS would be cheaper?

  • Which instance type are your using and how is the load of the current instances ? – Tensibai Jul 24 '18 at 11:53
  • Hi, thanks for the feedback. All smalls and mediums and the load is like 1,000,000 hits per day. – mutant_city Jul 24 '18 at 18:55
2

From your comment I assume a cpu load under 5% in average considering all instances together.

Each of your actual instance can be a pod on a kubernetes node, using quite larger instances you can reduce to a dozen of m3 or m4 machines with a single (or two) load balancer in front for the same quality of service.

You'll have machines used at 70% (ideally) and using an autoscaling group with a scaling policy to take care of spinning up a new node in case of burst.

The main idea is that you should be able to host on fewer machines with a better average load and thus reduce your cost, the first net gain is the reduction in number of load balancers, but this could be debated with Application Load balancers which allow to route by context or host.

Be warned there's a learning curve with kubernetes, but according to your description this sounds the perfect use case.

Beware of the 'all in k8s' trap, some things are better handled out of kubernetes, like large database systems or CPU/memory intensive task as they disrupt the load repartition and brings some more complexity. I.e: keep both possibilities, k8S and usual ASG/instances based hosting.

Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Not the answer you're looking for? Browse other questions tagged or ask your own question.