[Spark-k8s] — Getting started # Part 1

1. ohmyzsh

   1 617 183,400 9.4 Shell

   🙃 A delightful community-driven (with 2,400+ contributors) framework for managing your zsh configuration. Includes 300+ optional plugins (rails, git, macOS, hub, docker, homebrew, node, php, python, etc), 140+ themes to spice up your morning, and an auto-update tool that makes it easy to keep up with the latest updates from the community.

   

   Tip: I strongly advise installing this plugin if you use ohmyzsh because provides you an alternative to aliasing popular kubectl commands.

2. Stream

   getstream.io featured

   Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

   

3. spark-operator

   2 9 3,077 9.2 Go

   Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

   

   The SparkOperator must be installed before we can use Spark on Kubernetes. Google created this operator, which is available on Github. In a nutshell, the operator is in charge of monitoring the cluster for specific events related to the spark job, as known as kind: SparkApplication

4. data-engineer-projects

   3 1 1 2.2 Shell

   I hope this post was useful and you can find a complete example in my git repository.

Suggest a related project