News, guides, and engineering deep dives.
Practical guidance on Kafka, Flink, Iceberg, and real-time data.
How Airbnb uses Apache Kafka in production
A deep-dive into Airbnb's Kafka architecture — covering six production systems, 35+ billion daily events, SpinalTap CDC, Flink-based personalisation, and Kafka as a write-ahead log.
How Bytedance uses Apache Kafka in production
ByteDance ran Kafka at tens of TB/s before replacing it with ByteMQ, a Kafka-compatible platform separating storage from compute. How it works, and why migrating cut resource cost by roughly 70%.
How Cloudflare uses Apache Kafka in production
A deep-dive into Cloudflare's Kafka architecture: use cases at trillion-message scale, 14 clusters, internal tooling decisions, and the engineering lessons behind a decade of Kafka operations.
How DoorDash uses Apache Kafka in production
A deep dive into DoorDash's Kafka architecture, covering the Iguazu event platform, Flink-based ML feature pipelines, self-serve topic governance, and hundreds of billions of daily events.
How Goldman Sachs uses Apache Kafka in production
A deep-dive into Goldman Sachs's Kafka architecture — covering use cases across three divisions, migration to Amazon MSK, resilience design, and key engineering decisions.
How Grab uses Apache Kafka in production
A deep-dive into Grab's Kafka architecture — how the Coban team built a terabyte-per-hour streaming platform serving 300 billion events a week across GrabFood, GrabPay, mobility, and more.
How JPMorgan uses Apache Kafka in production
A deep dive into JPMorgan Chase's Kafka architecture, covering multi-tenant cluster design, managed Kafka Connect, the Photon Framework, and decisions behind a large-scale deployment.
How LinkedIn uses Apache Kafka in production
A deep-dive into LinkedIn's Kafka architecture, covering use cases, scale, engineering decisions, and key contributors.
How PayPal uses Apache Kafka in production
A deep-dive into PayPal's Kafka architecture — covering use cases, scale, engineering decisions, and key contributors across a fleet handling 1.3 trillion messages per day.