DEV Community

Cover image for #Pulumi with #GitHub Actions to provision a cluster on #AWS with #EKS
Anderson Gama
Anderson Gama

Posted on

#Pulumi with #GitHub Actions to provision a cluster on #AWS with #EKS

#iac #pulumi #github #eks

This is a model for creating in Python an EKS environment with the AWS provider on Pulumi using GitHub Actions.

Install AWS (Optional) 

cd /tmp ssh-keygen -f pulumi_eks_py_access curl "<https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip>" -o "awscliv2.zip" unzip awscliv2.zip && sudo ./aws/install aws configure aws ec2 import-key-pair --public-key-material "$(cat pulumi_eks_py_access.pub | base64)" --key-name pulumi_eks_py_access --region us-west-2 --profile yourprofile
Enter fullscreen mode Exit fullscreen mode

Download the PULUMI template 

mkdir -p $HOME/Pulumi cd $HOME/Pulumi git clone https://github.com/yourgithubuser/pulumi-iac-eks.git cd pulumi-iac-eks
Enter fullscreen mode Exit fullscreen mode

Install Pulumi on Linux by running the installation script: 

curl -fsSL https://get.pulumi.com | sh && bash
Enter fullscreen mode Exit fullscreen mode

Install Python VirtualEnv: 

sudo apt -y install python3-virtualenv
Enter fullscreen mode Exit fullscreen mode

Create a "pulumi_eks_py" project: 

cd $HOME/Pulumi/pulumi-iac-eks/pulumi_eks_py
Enter fullscreen mode Exit fullscreen mode

Note: If you want to change the name given to Kubernetes cluster, execute the command below in the template folder.

sed -i "s/"template-"/"desiredname-"/g" *.py
Enter fullscreen mode Exit fullscreen mode

Install Python Requirements 

python3 -m venv venv source venv/bin/activate python -m pip install --upgrade pip setuptools wheel python -m pip install -r requirements.txt
Enter fullscreen mode Exit fullscreen mode

Perform an initial deployment, run the following commands: 

pulumi login pulumi stack init pulumi_eks_py
Enter fullscreen mode Exit fullscreen mode

Set AWS_PROFILE: 

pulumi config set aws:profile yourprofile
Enter fullscreen mode Exit fullscreen mode

Set AWS_REGION: 

pulumi config set aws:region us-west-2
Enter fullscreen mode Exit fullscreen mode

Review the "pulumi_eks_py" project 

pulumi preview
Enter fullscreen mode Exit fullscreen mode

Enable Workflow 

cd $HOME/Pulumi/pulumi-iac-eks/.github/workflows
Enter fullscreen mode Exit fullscreen mode 
mv pull_request.yml.template pull_request.yml mv push.yml.template push.yml
Enter fullscreen mode Exit fullscreen mode

Environment Variables

There are a number of Environment Variables that can be set to interact with the action:

  • By default, Pulumi will try to connect to the Pulumi SaaS. For this to happen, the GitHub Action needs to be passed a "PULUMI_ACCESS_TOKEN".

Amazon Web Services (AWS)

For AWS, you'll need to create or use an existing IAM user for your action. Please see the Pulumi documentation page for pointers to the relevant AWS documentation for doing this.

As soon as you have an AWS user in hand, you'll set the environment variables "AWS_ACCESS_KEY_ID" and "AWS_SECRET_ACCESS_KEY" using GitHub Secrets, and then consume them in your action.

Note: Go to Settings> Secrets and add "PULUMI_ACCESS_TOKEN", "AWS_ACCESS_KEY_ID" and "AWS_SECRET_ACCESS_KEY" as new repository secret.

Commit the changes 

cd $HOME/Pulumi/pulumi-iac-eks/
Enter fullscreen mode Exit fullscreen mode 
git add * git add .github/workflows/* git add .pulumi/* git add pulumi_eks_py/* git commit -m "pulumi-iac-eks" git push
Enter fullscreen mode Exit fullscreen mode

Access EKS Kubernetes cluster 

sudo snap install kubectl --classic aws eks list-clusters --region us-west-2 --profile yourprofile aws eks --region us-west-2 --profile yourprofile update-kubeconfig --name $(pulumi stack output cluster-name) kubectl get po --all-namespaces
Enter fullscreen mode Exit fullscreen mode

Destroy the "pulumi_eks_py" project 

cd $HOME/Pulumi/pulumi-iac-eks/pulumi_eks_py pulumi destroy
Enter fullscreen mode Exit fullscreen mode

Remove the "pulumi_eks_py" project from Stack 

cd $HOME/Pulumi/pulumi-iac-eks/pulumi_eks_py pulumi stack rm pulumi_eks_py
Enter fullscreen mode Exit fullscreen mode

Source:

https://www.pulumi.com/docs/get-started/

https://www.pulumi.com/docs/reference/pkg/

https://www.pulumi.com/docs/intro/concepts/state/

https://www.pulumi.com/docs/guides/continuous-delivery/github-actions/

https://github.com/pulumi/actions

Top comments (1)

Collapse
 
smashse profile image
Anderson Gama •

Excellent article by Praneet Loke, thanks for the tip Martyna Łokuciejewska.
spacelift.io/blog/what-is-pulumi