Zookeeper, Drill and Hadoop HDFS docker containers based on Cent OS 7. Zookeeper cluster has 3 nodes. Drill cluster has 4 nodes. UDF directories are storing in HDFS.
Install Docker CE and cd to cloned repo root folder
-
Run
docker-compose -f local-setup.yml build -
Run
docker-compose -f local-setup.yml up -
Wait for 1-2 minutes as the cluster needs time for startup.
-
Run
docker swarm init --advertise-addr <MANAGER-IP>, where MANAGER-IP is the ip-address of your host machine. You can add another machines to your swarm cluster and connect them via generated token. -
Create overlay network with
vnetname. Rundocker network create -d overlay vnet -
Run
docker stack deploy --compose-file swarm-setup.yml drillStack -
Wait for 2-3 minutes as the cluster needs time for startup.