News, guides, and engineering deep dives.
Practical guidance on Kafka, Flink, Iceberg, and real-time data.
Kafka cluster management: A practical guide for engineers
A practical guide to Kafka cluster management: architecture sizing, day-to-day operations, performance tuning, KRaft migration, and monitoring for production clusters.
Kafka topic partition best practices
Size Kafka topic partitions correctly from day one. Covers the throughput formula, the keyed topic asymmetry, KRaft-era limits, and operational best practices.
The Complete Guide to Kafka Change Data Capture (CDC)
Learn how to implement change data capture with Kafka using Debezium. Includes working PostgreSQL CDC examples, architecture patterns, and monitoring.
Enhanced Under-Replicated Partition Detection in Kpow
Kpow now offers enhanced under-replicated partition (URP) detection for more accurate Kafka health monitoring. Our improved calculation correctly identifies URPs even when brokers are offline, providing a true, real-time view of your cluster's fault tolerance. This helps you proactively mitigate risks and ensure data durability.
How to monitor Kafka consumer lag: 5 options
Learn what Kafka consumer lag is, why it occurs, and how to monitor it using built-in tools, custom solutions, and Kafka monitoring platforms.
Integrate Kpow with WarpStream
Integrate Kpow with WarpStream in minutes. Gain unified visibility and control over your BYOC Kafka data plane and Schema Registry through our market-leading engineering console.
Introduction to Factor House Local
Jumpstart your journey into modern data engineering with Factor House Local. Explore pre-configured Docker environments for Kafka, Flink, Spark, and Iceberg, enhanced with enterprise-grade tools like Kpow and Flex. Our hands-on labs guide you step-by-step, from building your first Kafka client to creating a complete data lakehouse and real-time analytics system. It's the fastest way to learn, prototype, and build sophisticated data platforms.
KIP-1150 Diskless Topics: Rethinking Storage and Cloud Costs in Kafka
Discover how Kafka's KIP-1150 Diskless Topics aim to bring cloud-native scalability and cost-efficiency by natively utilizing object storage, and what it means for your streaming architecture.
KIP-932 Queues for Kafka: Bridging the Gap Between Streaming and Messaging
Discover how Kafka's KIP-932 Share Groups bring native queue semantics to your event streaming architecture, and the new complexities engineers must manage.