Skip to content
Navigation menu
Log in
Create account
Forem
Close
#
spark
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Big Data Fundamentals: spark
DevOps Fundamental
DevOps Fundamental
DevOps Fundamental
Follow
for
DevOps Fundamentals
Jun 30
Big Data Fundamentals: spark
#
bigdata
#
dataengineering
#
data
#
spark
Comments
Add Comment
6 min read
🚀 Docker + Spark on Kubernetes: Build Tiny Custom Executors in Minutes (2025)
Aleksei Aleinikov
Aleksei Aleinikov
Aleksei Aleinikov
Follow
May 2
🚀 Docker + Spark on Kubernetes: Build Tiny Custom Executors in Minutes (2025)
#
docker
#
kubernetes
#
spark
#
devops
Comments
Add Comment
1 min read
Setting Up IOMete: A Cloud-Independent Data Platform Based on Spark
Jacob
Jacob
Jacob
Follow
Jun 10
Setting Up IOMete: A Cloud-Independent Data Platform Based on Spark
#
iomete
#
spark
#
kubernetes
Comments
1
 comment
6 min read
Building a YouTube Channel Analytics Dashboard with Airflow, Spark, and Grafana
Eric Katumo
Eric Katumo
Eric Katumo
Follow
Apr 25
Building a YouTube Channel Analytics Dashboard with Airflow, Spark, and Grafana
#
postgres
#
spark
#
airflow
Comments
Add Comment
8 min read
Big Data Processing - Case Study 2 (Spark)
01:52
Afrar Malakooth
Afrar Malakooth
Afrar Malakooth
Follow
Apr 24
Big Data Processing - Case Study 2 (Spark)
#
bigdata
#
spark
#
dataengineering
Comments
Add Comment
1 min read
Complete Beginner's Guide: Building a Weather ETL Pipeline with PySpark
Navas Herbert
Navas Herbert
Navas Herbert
Follow
Jun 6
Complete Beginner's Guide: Building a Weather ETL Pipeline with PySpark
#
programming
#
dataengineering
#
spark
#
etl
2
 reactions
Comments
1
 comment
5 min read
How to treat secure data on lakehouse
kination
kination
kination
Follow
Apr 8
How to treat secure data on lakehouse
#
dataengineering
#
python
#
spark
1
 reaction
Comments
Add Comment
3 min read
Spark On Kubernetes
Keyvan Soleimani
Keyvan Soleimani
Keyvan Soleimani
Follow
May 5
Spark On Kubernetes
#
kubernetes
#
spark
#
docker
#
bigdata
1
 reaction
Comments
Add Comment
4 min read
Big Data Processing - Case Study 4 (Spark)
02:36
Afrar Malakooth
Afrar Malakooth
Afrar Malakooth
Follow
May 1
Big Data Processing - Case Study 4 (Spark)
#
bigdata
#
spark
#
dataengineering
#
datascience
Comments
Add Comment
1 min read
Big Data Processing - Case Study 3 (Spark)
02:35
Afrar Malakooth
Afrar Malakooth
Afrar Malakooth
Follow
Apr 26
Big Data Processing - Case Study 3 (Spark)
#
bigdata
#
spark
#
dataengineering
#
tutorial
Comments
Add Comment
1 min read
Big Data Processing - Case Study 1 (Spark)
01:32
Afrar Malakooth
Afrar Malakooth
Afrar Malakooth
Follow
Apr 23
Big Data Processing - Case Study 1 (Spark)
#
bigdata
#
programming
#
spark
#
dataengineering
Comments
Add Comment
1 min read
Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query
Pizofreude
Pizofreude
Pizofreude
Follow
Mar 4
Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query
#
dataengineering
#
dezoomcamp
#
spark
#
bigquery
Comments
Add Comment
8 min read
Study Notes 5.5.1-2 Operations on Spark RDDs & Spark RDD mapPartition
Pizofreude
Pizofreude
Pizofreude
Follow
Mar 4
Study Notes 5.5.1-2 Operations on Spark RDDs & Spark RDD mapPartition
#
dataengineering
#
dezoomcamp
#
spark
#
rdd
Comments
Add Comment
9 min read
Study Notes 5.6.1-2 Spark on cloud & local
Pizofreude
Pizofreude
Pizofreude
Follow
Mar 4
Study Notes 5.6.1-2 Spark on cloud & local
#
dataengineering
#
dezoomcamp
#
spark
#
cloud
Comments
Add Comment
7 min read
Study Notes 5.4.1-3 Anatomy of a Spark Cluster GroupBy & Joins in Spark
Pizofreude
Pizofreude
Pizofreude
Follow
Mar 4
Study Notes 5.4.1-3 Anatomy of a Spark Cluster GroupBy & Joins in Spark
#
dataengineering
#
dezoomcamp
#
sql
#
spark
Comments
Add Comment
11 min read
Tiny URL Design
Abhishek Prajapati
Abhishek Prajapati
Abhishek Prajapati
Follow
Mar 3
Tiny URL Design
#
mysql
#
redis
#
kafka
#
spark
Comments
Add Comment
10 min read
Automatizando a Qualidade de Dados com DQX: Performance e praticidade
Airton Lira junior
Airton Lira junior
Airton Lira junior
Follow
Feb 27
Automatizando a Qualidade de Dados com DQX: Performance e praticidade
#
dqx
#
spark
#
databricks
#
python
Comments
Add Comment
5 min read
Azure Data Engineering Books from #Techtter YT Channel
Techtter
Techtter
Techtter
Follow
Feb 20
Azure Data Engineering Books from #Techtter YT Channel
#
azure
#
dataengineering
#
spark
Comments
Add Comment
1 min read
AWS Glue vs AWS Lambda: Comparativa Serverless para IngenierĂa de Datos en AWS
Jose Luis Ariza
Jose Luis Ariza
Jose Luis Ariza
Follow
Feb 16
AWS Glue vs AWS Lambda: Comparativa Serverless para IngenierĂa de Datos en AWS
#
awsglue
#
lambda
#
serverless
#
spark
1
 reaction
Comments
Add Comment
4 min read
Big Boost for Flink & Spark SQL: Both Tools Just Got Updated!
DogeKing
DogeKing
DogeKing
Follow
Feb 8
Big Boost for Flink & Spark SQL: Both Tools Just Got Updated!
#
sql
#
sparksql
#
spark
#
flinksql
Comments
Add Comment
1 min read
Designing a Scalable Shuffle Service for Big Data on AWS
Chat Rathnayake
Chat Rathnayake
Chat Rathnayake
Follow
Feb 5
Designing a Scalable Shuffle Service for Big Data on AWS
#
aws
#
spark
#
bigdata
#
cloudnative
Comments
Add Comment
3 min read
Study Notes 5.1.1-2 Introduction to Batch Processing & spark
Pizofreude
Pizofreude
Pizofreude
Follow
Mar 4
Study Notes 5.1.1-2 Introduction to Batch Processing & spark
#
dataengineering
#
dezoomcamp
#
batchprocessing
#
spark
1
 reaction
Comments
Add Comment
6 min read
Study Notes 5.3.3-4 Data Processing & SQL with Spark
Pizofreude
Pizofreude
Pizofreude
Follow
Mar 4
Study Notes 5.3.3-4 Data Processing & SQL with Spark
#
dataengineering
#
dezoomcamp
#
sql
#
spark
1
 reaction
Comments
Add Comment
9 min read
How to be Test Driven with Spark: Chapter 3 - First Spark test
Nicoda-27
Nicoda-27
Nicoda-27
Follow
Mar 1
How to be Test Driven with Spark: Chapter 3 - First Spark test
#
spark
#
python
#
testing
#
productivity
Comments
Add Comment
7 min read
Like IDE for SparkSQL: Support Pycharm! SparkSQLHelper v2025.1.1 released
DogeKing
DogeKing
DogeKing
Follow
Jan 14
Like IDE for SparkSQL: Support Pycharm! SparkSQLHelper v2025.1.1 released
#
sql
#
tooling
#
sparksql
#
spark
Comments
Add Comment
1 min read
loading...
We're a blogging-forward open source social network where we learn from one another
Log in
Create account
