Docker Community Forums

Share and learn in the Docker community.

Multi-node HDP cluster with docker containers

(Jagsnel) #1

Hi All,

I have Docker CE (Version 17.12.0-ce-mac49) installed on my MacPro. Here I copied my Mac configuration.

MacBook Pro (15-inch, 2017)
Processor: 2.9 GHz Intel Core i7
Memory: 16 GB 2133 MHz LPDDR3
Graphics: Radeon Pro 560 4 GB Intel HD Graphics 630 1536 MB

I am trying to build Hadoop cluster with HDP (Hortonworks) distribution.

I have started 5 containers.
1 - Oracle DB
1 - Ambari Server (with OEL 6.8 image)
3 - Cluster Nodes (with OEL 6.8 image)

Each cluster node required 2GB memory and 2 cores.

Using Ambari Wizard, I have started building cluster. While installing components, I see mac fan is so noisy. After some time Ambari UI stopped responding and forced to quit containers and docker restart.

After above I started all containers again and I see all components installed. But when I start any service, same response as above.

Anyone tried creating multi-node cluster using docker. Can someone help me here what am I missing.
Is my Mac not supportive enough to build a cluster like above.