DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Apache Iceberg Table Optimization #2: The Basics of Compaction — Bin Packing Your Data for Efficiency
alexmercedcoder profile

Apache Iceberg Table Optimization #2: The Basics of Compaction — Bin Packing Your Data for Efficiency

#dataengineering #database #datascience #apacheiceberg
Comments
3 min read
Big Data Fundamentals: big data tutorial
devops_fundamental profile

Big Data Fundamentals: big data tutorial

#bigdata #dataengineering #data #bigdatatutorial
1
Comments
5 min read
Big Data Fundamentals: big data tutorial
devops_fundamental profile

Big Data Fundamentals: big data tutorial

#bigdata #dataengineering #data #bigdatatutorial
1
Comments
5 min read
Apache Iceberg Table Optimization #7: Using Iceberg Metadata Tables to Determine When Compaction Is Needed
alexmercedcoder profile

Apache Iceberg Table Optimization #7: Using Iceberg Metadata Tables to Determine When Compaction Is Needed

#database #datascience #dataengineering #apacheiceberg
Comments
3 min read
Apache Iceberg Table Optimization #5: Avoiding Metadata Bloat with Snapshot Expiration and Rewriting Manifests
alexmercedcoder profile

Apache Iceberg Table Optimization #5: Avoiding Metadata Bloat with Snapshot Expiration and Rewriting Manifests

#database #datascience #dataengineering #apacheiceberg
Comments
3 min read
Apache Iceberg Table Optimization #4: Smarter Data Layout — Sorting and Clustering Iceberg Tables
alexmercedcoder profile

Apache Iceberg Table Optimization #4: Smarter Data Layout — Sorting and Clustering Iceberg Tables

#database #datascience #dataengineering #apacheiceberg
1
Comments
3 min read
Big Data Fundamentals: big data tutorial
devops_fundamental profile

Big Data Fundamentals: big data tutorial

#bigdata #dataengineering #data #bigdatatutorial
1
Comments
5 min read
Apache Iceberg Table Optimization #1: The Cost of Neglect — How Apache Iceberg Tables Degrade Without Optimization
alexmercedcoder profile

Apache Iceberg Table Optimization #1: The Cost of Neglect — How Apache Iceberg Tables Degrade Without Optimization

#apacheiceberg #dataengineering #datascience
Comments
3 min read
Apache Iceberg Table Optimization #3: Optimizing Compaction for Streaming Workloads in Apache Iceberg
alexmercedcoder profile

Apache Iceberg Table Optimization #3: Optimizing Compaction for Streaming Workloads in Apache Iceberg

#database #datascience #dataengineering #apacheiceberg
Comments
3 min read
Database Design Errors to Avoid & How To Fix Them
roxana_haidiner profile

Database Design Errors to Avoid & How To Fix Them

#database #sql #mysql #dataengineering
11
Comments 1
5 min read
Cross-Platform Multi-Channel Attribution in Marketing: Balancing Costs and Results Across Devices
andrey_s profile

Cross-Platform Multi-Channel Attribution in Marketing: Balancing Costs and Results Across Devices

#analytics #marketing #attribution #dataengineering
1
Comments
5 min read
🛒 Real-Life Data Lakehouse Use Case: Revolutionizing Retail Analytics
qvfagundes profile

🛒 Real-Life Data Lakehouse Use Case: Revolutionizing Retail Analytics

#datascience #dataengineering #data #ai
1
Comments
2 min read
Data and analytics reimagined with Terraform and DevOps principles
ivicak profile

Data and analytics reimagined with Terraform and DevOps principles

#dataengineering #snowflake #terraform #devops
Comments
3 min read
Top Trends and Applications in Data Engineering and AI for the Modern Enterprise
crmsoftware361 profile

Top Trends and Applications in Data Engineering and AI for the Modern Enterprise

#erpsoftware #dynamics365 #dataengineering #ai
Comments 1
5 min read
A Real-Time Earthquake Monitoring Pipeline with Kafka, MySQL, PostgreSQL, and Grafana
dkkinyua profile

A Real-Time Earthquake Monitoring Pipeline with Kafka, MySQL, PostgreSQL, and Grafana

#python #dataengineering #data
3
Comments
4 min read
Pandas vs Polars: Is It Time to Rethink Python’s Trusted DataFrame Library?
emmanuel_kiriinya_416fc40 profile

Pandas vs Polars: Is It Time to Rethink Python’s Trusted DataFrame Library?

#datascience #pandas #polars #dataengineering
3
Comments 2
3 min read
Big Data Fundamentals: big data project
devops_fundamental profile

Big Data Fundamentals: big data project

#bigdata #dataengineering #data #bigdataproject
5
Comments
5 min read
Big Data Fundamentals: big data tutorial
devops_fundamental profile

Big Data Fundamentals: big data tutorial

#bigdata #dataengineering #data #bigdatatutorial
5
Comments
5 min read
Big Data Fundamentals: big data
devops_fundamental profile

Big Data Fundamentals: big data

#bigdata #dataengineering #data
5
Comments
6 min read
Big Data Fundamentals: big data example
devops_fundamental profile

Big Data Fundamentals: big data example

#bigdata #dataengineering #data #bigdataexample
5
Comments
5 min read
Building a Real-Time Crypto Pipeline with Binance APIs, PostgreSQL, Debezium, Kafka, Spark & Cassandra
dkkinyua profile

Building a Real-Time Crypto Pipeline with Binance APIs, PostgreSQL, Debezium, Kafka, Spark & Cassandra

#python #cryptocurrency #data #dataengineering
2
Comments
6 min read
Architecting your GenAI data pipeline with AWS native services
arturschneider profile

Architecting your GenAI data pipeline with AWS native services

#aws #genai #data #dataengineering
6
Comments
10 min read
BEGINNER'S GUIDE TO STREAM REAL-TIME DATA USING APACHE KAFKA
vesmunger profile

BEGINNER'S GUIDE TO STREAM REAL-TIME DATA USING APACHE KAFKA

#dataengineering #kafka #python
Comments
4 min read
Stop Drawing ETL Diagrams — Your Python Code Visualizes Itself
edwardvaneechoud profile

Stop Drawing ETL Diagrams — Your Python Code Visualizes Itself

#python #dataengineering #opensource #programming
4
Comments
4 min read
⚡ Kafka ClickHouse: Real-Time Data Pipeline for Beginners
mohhddhassan profile

⚡ Kafka ClickHouse: Real-Time Data Pipeline for Beginners

#dataengineering #kafka #clickhouse #docker
2
Comments
2 min read
loading...