Forem

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

๐Ÿ‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Kafka Architecture - The Complete Mental Model ๐Ÿง 
Cover image for Kafka Architecture - The Complete Mental Model ๐Ÿง 

Kafka Architecture - The Complete Mental Model ๐Ÿง 

Comments
7 min read
Orchestrating Complex Processes in Node.js with @jescrich/nestjs-workflow

Orchestrating Complex Processes in Node.js with @jescrich/nestjs-workflow

Comments
3 min read
Understanding Kafka Lag: Causes and Mitigation Strategies
Cover image for Understanding Kafka Lag: Causes and Mitigation Strategies

Understanding Kafka Lag: Causes and Mitigation Strategies

Comments
4 min read
Building a Real-Time Crypto Data Pipeline with Debezium CDC
Cover image for Building a Real-Time Crypto Data Pipeline with Debezium CDC

Building a Real-Time Crypto Data Pipeline with Debezium CDC

Comments
5 min read
Did I just create the fastest BPMN engine in the world?

Did I just create the fastest BPMN engine in the world?

Comments
1 min read
Undestanding Kafka Lag, Why It Happens and How To Fix It.
Cover image for Undestanding Kafka Lag, Why It Happens and How To Fix It.

Undestanding Kafka Lag, Why It Happens and How To Fix It.

2
Comments
4 min read
Demystifying Confluent's Schema Registry Wire Format
Cover image for Demystifying Confluent's Schema Registry Wire Format

Demystifying Confluent's Schema Registry Wire Format

Comments
13 min read
Reducing Consumer Lag in Apache Kafka
Cover image for Reducing Consumer Lag in Apache Kafka

Reducing Consumer Lag in Apache Kafka

5
Comments
3 min read
Understanding Kafka Lag: Causes and How to Reduce It

Understanding Kafka Lag: Causes and How to Reduce It

Comments
5 min read
Wednesday Links - Edition 2025-11-05

Wednesday Links - Edition 2025-11-05

Comments
2 min read
Integration Digest for October 2025
Cover image for Integration Digest for October 2025

Integration Digest for October 2025

Comments
12 min read
How to build real-time user-facing analytics with Kafka + Flink + Doris

How to build real-time user-facing analytics with Kafka + Flink + Doris

4
Comments
9 min read
JayNats: The Future of Message Brokers

JayNats: The Future of Message Brokers

Comments
5 min read
Docker Compose - Simple Kafka
Cover image for Docker Compose - Simple Kafka

Docker Compose - Simple Kafka

Comments
1 min read
Building a Mini Kafka in Go โ€” My Journey Creating go-pub-sub
Cover image for Building a Mini Kafka in Go โ€” My Journey Creating go-pub-sub

Building a Mini Kafka in Go โ€” My Journey Creating go-pub-sub

1
Comments
4 min read
How Software Architects Choose the Right Technology Stack

How Software Architects Choose the Right Technology Stack

1
Comments
3 min read
Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

5
Comments
2 min read
Data Intelligence Tokyo #20: Managing Schemas with Apache Kafka

Data Intelligence Tokyo #20: Managing Schemas with Apache Kafka

Comments
1 min read
Kafka Backfill Patterns: A Guide to Accessing Historical Data

Kafka Backfill Patterns: A Guide to Accessing Historical Data

5
Comments
7 min read
Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)
Cover image for Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Comments
3 min read
Good Things (Compression) Take Time!

Good Things (Compression) Take Time!

1
Comments
6 min read
A new tool to automatically detect and fix common Apache Kafka issues (looking for feedback)

A new tool to automatically detect and fix common Apache Kafka issues (looking for feedback)

2
Comments
1 min read
Building a Simple Event-Driven Microservices System with Apache Kafka

Building a Simple Event-Driven Microservices System with Apache Kafka

3
Comments
2 min read
Making Kafka 7,658x slower for theย Lulz
Cover image for Making Kafka 7,658x slower for theย Lulz

Making Kafka 7,658x slower for theย Lulz

Comments
7 min read
๐Ÿšš ๐—Ÿ๐—ผ๐—ด๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ ๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ ๐—ข๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ โ€” ๐—ฏ๐˜‚๐—ถ๐—น๐˜ (๐˜€๐—ฎ๐—ป๐—ฒ๐—น๐˜†) ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ

๐Ÿšš ๐—Ÿ๐—ผ๐—ด๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ ๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ ๐—ข๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ โ€” ๐—ฏ๐˜‚๐—ถ๐—น๐˜ (๐˜€๐—ฎ๐—ป๐—ฒ๐—น๐˜†) ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ

2
Comments
2 min read
loading...