I am trying to scale my current application sitting in a single host to a multi-host architecture with as minimal effort as possible. i.e. not really want to use Swarm or even Kubernetes as seems overkill
I do not really need replica management provided by Swarm or Kubernetes as I think only one container is enough. The use case is to only spin up several more containers in another new server and at the same time, they can talk to some/all containers (ideally by referring to the container name) in the original server.
My idea is to keep everything simple by keeping everything untouched in the current server A running my app. However, add a new server B in the same network to accommodate a few more containers (those containers can be though as stateless worker containers to consume tasks in a queue in the Redis container within server A).
Currently, server A just simply uses a custom bridge network to connect all containers together in the same host, which works fine. Also, I know that I can use an overlay network to achieve across-node communication between containers.
So my questions are:
First, Can I achieve it without Swarm? or still good to use swarm due to some reasons?
Second, for each container currently in server A, do all of them need to replace the current bridge network with a new overlay network? or only part of them that need to talk with containers in server B without changing the bridge network for other containers? or one container can join two networks (i.e. bridge and overlay)