This repository defines multiple Ansible Roles to help deploying and configuring a Kubernetes cluster with JupyterHub, Jupyter Enterprise Gateway and Elyra extensions to JupyterLab Notebooks.
You will need a driver machine with ansible installed and a clone of the current repository:
- If you are running on cloud (public/private network)
- Install ansible on the edge node (with public ip)
- if you are running on private cloud (public network access to all nodes)
- Install ansible on your laptop and drive the deployment from it
curl -O https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm sudo rpm -i epel-release-latest-7.noarch.rpm sudo yum update -y sudo yum install -y ansible - Install Annaconda
- Use pip install ansible
pip install --upgrade ansible In order to have variable overriding from host inventory, please add the following configuration into your ~/.ansible.cfg file
[defaults] host_key_checking = False hash_behaviour = merge command_warnings = False - RHEL 7.x
- Ansible 2.10.3
- common: Basic OS updates and configurations common to all scenarios
- kubernetes: Basic Kubernetes platform and utilities required to run either Jupyter or Spark environments
- jupyter-enterprise-gateway: Deploy necessary images for Jupyter Enterprise Gateway and supported kernels
- jupyterhub: Deploy JupyterHub environment using custom Notebook image for remote kernels (using Enterprise Gateway)
Ansible uses 'host inventory' files to define the cluster configuration, nodes, and groups of nodes that serves a given purpose (e.g. master node, worker nodes, etc).
Below is a host inventory sample definition:
[all:vars] [master] lresende-kube-node-1 ansible_host=9.30.109.214 ansible_host_private=172.16.186.211 [nodes] lresende-kube-node-2 ansible_host=9.30.123.95 ansible_host_private=172.16.202.136 lresende-kube-node-3 ansible_host=9.30.188.28 ansible_host_private=172.16.202.144 lresende-kube-node-4 ansible_host=9.30.188.36 ansible_host_private=172.16.203.8 lresende-kube-node-5 ansible_host=9.30.188.38 ansible_host_private=172.16.210.6 The sample setup-kubernetes.yml playbook deploys a Kubernetes cluster and configure JupyterHub and Elyra extensions to JupyterLab Notebooks.
- name: setup kubernetes hosts: all remote_user: root roles: - role: common - role: kubernetes - role: jupyter-enterprise-gateway - role: jupyterhubansible-playbook --verbose <deployment playbook.yml> -i <hosts inventory> Example:
ansible-playbook --verbose setup-kubernetes.yml -c paramiko -i hosts-fyre-kubernetes