I have two containers (Docker):
- TensorFlow container
- NodeJS container used as a frontend to the TensorFlow container.
Both containers have TCP listeners on a port specified using environment variables.
If I want to scale the NodeJS and TensorFlow containers, for example 2 instances of NodeJS and 4 instances of TensorFlow, what are my options for connecting them to evenly spread the load across the 4 instances of TensorFlow?
Currently I'm using the TensorFlow container name inside the NodeJS container, but I'm pretty sure that would only take advantage of a single TensorFlow container... Or??