Docker Community Forums

Share and learn in the Docker community.

How do I connect multiple docker containers on multiple hosts to form a hadoop cluster?

aws
docker

(Trtngn) #1

Hello,

I am trying to build a hadoop cluster using purely docker containers. Getting the images to build with the tools is not an issue, the problem lies in communication with each other. Right now I am using weavenet to simulate a SDN which works relatively well on a local cluster. But moving this dependency to AWS requires too much work and a lot of unknowns.

My question is, does docker come with the ability to simulate a network, or add to an existing network, so that the containers are able to communicate with each other while not impeding with the host’s own network?

I am not an expert in networking whatsoever. I have very basic networking knowledge so please excuse my poorly written question.