0

Is it possible to deploy 1 pod per each REST request? My process starts up in .004s and is about 1GB in size. After the REST request completes the pod will terminate.

Given that I'd like to deploy the pod/container for this on each REST request. Is it possible to do this in < 200ms? A sort of serverless architecture using kubernetes.

How would you do this in a reliable / resilient way?

0

As per my experience, it is not a good idea because the availability of a pod is not directly related to how fast the container is up, a lot of other things affects the time the pod is ready and the time kubernetes sends traffic to that new pod.

You need to think about how your scalability strategy is trying to adapt to your actual traffic and the different health checks change that readiness time.

In Kubernete you have the livenessProbe and radynessProbe used to check two different thinks on the lifecycle of the pod, because of that you need to review the lifecycle of a pod in kubernetes and if your app can adapt to it.

https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle/

In case you are worried about the number of requests you can handle per second my advice is to have a pool of pods ready to response a good amount of it and take metrics to know better how your app responds to a high demanding traffic context and understand how the loadbalancing of kubenetes work and can affect your app, with that try to scale in a more smart way.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.