DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Apache Iceberg Dev List Digest (Sept 15–19, 2025)

Apache Iceberg Dev List Digest (Sept 15–19, 2025)

Comments
3 min read
Apache Polaris Dev List Digest (Sept 15–19, 2025)

Apache Polaris Dev List Digest (Sept 15–19, 2025)

Comments
4 min read
CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium

CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium

Comments
5 min read
Building a Reddit Sentiment Pipeline using Python, PostgreSQL, VADER, Airflow, Grafana, Prometheus and StatsD

Building a Reddit Sentiment Pipeline using Python, PostgreSQL, VADER, Airflow, Grafana, Prometheus and StatsD

1
Comments 1
5 min read
Apache Kafka & Amazon MSK: The Beating Heart of Real-Time Data

Apache Kafka & Amazon MSK: The Beating Heart of Real-Time Data

1
Comments
4 min read
Migrating Oracle Fusion Cloud Data to Azure Fabric: A Practical Guide

Migrating Oracle Fusion Cloud Data to Azure Fabric: A Practical Guide

Comments
3 min read
Migrating Oracle Fusion Cloud Data to Azure Fabric: A Practical Guide

Migrating Oracle Fusion Cloud Data to Azure Fabric: A Practical Guide

Comments
3 min read
Streaming Data Using Apache Kafka

Streaming Data Using Apache Kafka

1
Comments
2 min read
SUPCON Uses SeaTunnel to Build an Efficient Data Collection Framework, Achieving 0 Failures in Core Data Synchronization Tasks!

SUPCON Uses SeaTunnel to Build an Efficient Data Collection Framework, Achieving 0 Failures in Core Data Synchronization Tasks!

Comments
14 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
7 min read
Hackeando o Data Engineering: Os Padrões que Todo Engenheiro Precisa Conhecer

Hackeando o Data Engineering: Os Padrões que Todo Engenheiro Precisa Conhecer

Comments
1 min read
Beginner guide for Apache Kafka

Beginner guide for Apache Kafka

Comments
1 min read
Apache Kafka in Data Engineering

Apache Kafka in Data Engineering

Comments
1 min read
Apache Kafka in Data Engineering for Beginners

Apache Kafka in Data Engineering for Beginners

Comments
1 min read
Apache Kafka in Data Engineering.

Apache Kafka in Data Engineering.

Comments
1 min read
🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)

🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)

2
Comments
2 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

1
Comments
4 min read
All About Change Data Capture CDC

All About Change Data Capture CDC

1
Comments
6 min read
Automating Your Local DBT & Snowflake Playground with Python

Automating Your Local DBT & Snowflake Playground with Python

2
Comments
10 min read
🚀 Day 17 of My Python Learning Journey

🚀 Day 17 of My Python Learning Journey

Comments
1 min read
Sagas vs ACID Transactions: Ensuring Reliability in Distributed Architectures

Sagas vs ACID Transactions: Ensuring Reliability in Distributed Architectures

1
Comments
11 min read
Break Through Data Silos: Practices of Multi-cloud Observability Integration Based on Object Storage Service (OSS)

Break Through Data Silos: Practices of Multi-cloud Observability Integration Based on Object Storage Service (OSS)

5
Comments
12 min read
Real-Time CDC with Debezium and Kafka for Sharded PostgreSQL Integration

Real-Time CDC with Debezium and Kafka for Sharded PostgreSQL Integration

1
Comments
9 min read
Apache Kafka in Data engineering

Apache Kafka in Data engineering

6
Comments 1
1 min read
Column-Oriented Databases: A Technical Overview

Column-Oriented Databases: A Technical Overview

Comments
6 min read
loading...