Kafka Streams — State Stores & RocksDB Tuning
Deep dive into Kafka Streams state stores, RocksDB LSM-tree mechanics, Linux OS Page Cache, preventing Kubernetes cgroup OOMKilled with RocksDBConfigSetter, State TTL, and checkpointing.
Deep dive into Kafka Streams state stores, RocksDB LSM-tree mechanics, Linux OS Page Cache, preventing Kubernetes cgroup OOMKilled with RocksDBConfigSetter, State TTL, and checkpointing.
How to replace or offload the RocksDB state store with Redis in Kafka Streams / Kafka consumers, avoid full local state restore, and prevent lost or duplicated messages during batch processing by combining per-partition offset fencing, partition-key validation, epoch fencing and atomic Lua scripts.