DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Tableau Sales Dashboard Performance (Updated for 2025)

Tableau Sales Dashboard Performance (Updated for 2025)

1
Comments
4 min read
Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena

Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena

2
Comments
4 min read
Big Data Fundamentals: data pipeline with python

Big Data Fundamentals: data pipeline with python

Comments
6 min read
Big Data Fundamentals: data pipeline tutorial

Big Data Fundamentals: data pipeline tutorial

Comments
6 min read
Data Science vs Business Analytics

Data Science vs Business Analytics

Comments
1 min read
Big Data Fundamentals: data pipeline example

Big Data Fundamentals: data pipeline example

Comments
6 min read
Big Data Fundamentals: data pipeline

Big Data Fundamentals: data pipeline

Comments
6 min read
What Is Change Data Capture (CDC) and How It Works on Google Cloud

What Is Change Data Capture (CDC) and How It Works on Google Cloud

Comments
2 min read
💾 Parquet or Avro? CSV or JSON?

💾 Parquet or Avro? CSV or JSON?

Comments
1 min read
Reading CSVs with varying column counts that pandas cannot read using DuckDB

Reading CSVs with varying column counts that pandas cannot read using DuckDB

1
Comments
3 min read
Working with Apache to automate collection of Weather data for Kenya’s major Agricultural Areas

Working with Apache to automate collection of Weather data for Kenya’s major Agricultural Areas

Comments
5 min read
2025 Data Warehouse Benchmark: What BigQuery, Snowflake, and Others Don’t Tell You

2025 Data Warehouse Benchmark: What BigQuery, Snowflake, and Others Don’t Tell You

1
Comments
2 min read
Big Data Fundamentals: data warehouse example

Big Data Fundamentals: data warehouse example

Comments
5 min read
Big Data Fundamentals: data warehouse

Big Data Fundamentals: data warehouse

Comments
6 min read
Big Data Fundamentals: data lake with python

Big Data Fundamentals: data lake with python

Comments
6 min read
Big Data Fundamentals: data lake tutorial

Big Data Fundamentals: data lake tutorial

Comments
6 min read
Big Data Fundamentals: data lake project

Big Data Fundamentals: data lake project

Comments
6 min read
Big Data Fundamentals: data lake example

Big Data Fundamentals: data lake example

Comments
6 min read
What Is Data Lineage? Learn How to Trace Your Data’s Journey

What Is Data Lineage? Learn How to Trace Your Data’s Journey

Comments
2 min read
Building a Data Career: The Skills That Truly Matter

Building a Data Career: The Skills That Truly Matter

10
Comments
5 min read
Unable to emit metadata to DataHub GMS with Airflow - a solution

Unable to emit metadata to DataHub GMS with Airflow - a solution

Comments
4 min read
Snowflake RBAC 101 – Episode 2: Role Hierarchies & Least Privilege

Snowflake RBAC 101 – Episode 2: Role Hierarchies & Least Privilege

Comments
1 min read
Lightweight ETL with AWS Glue Python Shell, DuckDB, and PyIceberg

Lightweight ETL with AWS Glue Python Shell, DuckDB, and PyIceberg

2
Comments 1
7 min read
PyIceberg on AWS Lambda: Comparing GlueCatalog and REST Catalog Access Methods

PyIceberg on AWS Lambda: Comparing GlueCatalog and REST Catalog Access Methods

1
Comments
3 min read
Big Data Fundamentals: data lake

Big Data Fundamentals: data lake

Comments
6 min read
loading...