Data Streaming/Processing blog posts

Infrastructure

Optimizing LinkedIn Sales Navigator’s search pipeline with Spark

Chunxu Tang

Jul 23, 2025
Infrastructure

Introducing Northguard and Xinfra: scalable log storage at Lin...

Onur Karaman

Jun 25, 2025
Infrastructure

Stateful workload operator: stateful systems on Kubernetes at ...

Michael Youssef

Nov 12, 2024
Data Management

Scalable Automated Config-Driven Data Validation with ValiData

Bharadwaj Jayaraman

Mar 7, 2024
Improving Recruiting Efficiency with a Hybrid Bulk Data Proces...

Aditya Hegde

Jan 19, 2024
Data Streaming/Processing

Revolutionizing Real-Time Streaming Processing: 4 Trillion Eve...

Bingfeng Xia

Oct 19, 2023
Data Streaming/Processing

Declarative Data Pipelines with Hoptimator

Ryanne Dolan

Jun 26, 2023
Data Streaming/Processing

Unified Streaming And Batch Pipelines At LinkedIn: Reducing Pr...

Mar 23, 2023
Analytics

Real-time analytics on network flow data with Apache Pinot

Sep 13, 2022
Open Source

FastIngest: Low-latency Gobblin with Apache Iceberg and ORC fo...

Zihan Li

Jan 6, 2021
Data Science

From Lambda to Lambda-less: Lessons learned

Dec 1, 2020
Open Source

Building a better and faster Beam Samza runner

Oct 1, 2020