Deduplication in Distributed Messaging — Kafka, Kafka Streams, RabbitMQ, SQS, Redis
A comprehensive guide to preventing duplicate message processing across Kafka, Kafka Streams, RabbitMQ, SQS, and Redis — covering EOS internals, Kafka Streams State Store vs Redis architecture, idempotent consumers, and production deduplication patterns for senior engineers.
Kafka Exactly-Once Semantics (EOS)
A complete guide to Kafka exactly-once semantics — delivery guarantees, idempotent producer, transactions, read_committed consumers, Kafka Streams EOS, zombie producer fencing, two-phase commit internals, and production patterns.
Kafka Streams — Complete Deep Dive
A comprehensive guide to Kafka Streams: from core concepts and internal architecture to stateful processing, failure recovery, exactly-once semantics, windowing, joins, interactive queries, and production system design patterns.
Kafka Streams — Core Abstractions & Architecture
A principal-level deep dive into Kafka Streams core concepts: mental model, KStream vs KTable vs GlobalKTable, duality of streams and tables, and stateless operations.
Kafka Streams — Processor API (PAPI), DLQ & Deduplication
Deep dive into Kafka Streams Modern Processor API (PAPI 3.x+), Wall-Clock vs Stream-Time Punctuators, WindowStore event deduplication, Dead Letter Queue (DLQ) DeserializationExceptionHandler, the Async Network I/O anti-pattern, and Schema Registry Serdes.
Kafka Streams — Production Runbook, Testing & Anti-Patterns
Production operations guide for Kafka Streams: unit testing with TopologyTestDriver, observability metrics runbook, 7 fatal anti-patterns, 5-way streaming engine comparison, system design architectures, and complete failure mitigation matrix.
Kafka Streams — Senior & Principal Interview Questions
15 rigorous senior and principal staff engineer interview questions on Kafka Streams, covering Stream-Time traps, RocksDB cgroup OOMs, Cooperative Sticky Assignor, EOS V2 transaction internals, sub-topology reorder storms, and The Four Golden Rules.
Kafka Streams — Spring Boot Integration Deep Dive
Comprehensive guide to running Kafka Streams in Spring Boot: spring-kafka vs Spring Cloud Stream, StreamsBuilderFactoryBean lifecycle, topology composition across @Bean methods, branching with split() vs onTopOf(), safe Interactive Queries, and health probes.
Kafka Streams — State Stores & RocksDB Tuning
Deep dive into Kafka Streams state stores, RocksDB LSM-tree mechanics, Linux OS Page Cache, preventing Kubernetes cgroup OOMKilled with RocksDBConfigSetter, State TTL, and checkpointing.
Kafka Streams — Topology Architecture & Execution Model
Deep dive into Kafka Streams DAG compilation, branching with KafkaStreamBrancher.onTopOf, topology merging, execution tasks, threading model, scaling math, and rebalance storm runbooks.
Kafka Streams — Windowing & Stream Joins
In-depth guide to Kafka Streams window types, the suppress() stalled stream-time trap, stream-stream and stream-table joins, and the co-partitioning troubleshooting checklist.