Kafka exactly-once delivery demystified: the 3-layer design and the catch engineers miss
arpit_bhayani · x · 2026-09-04
Engineer Arpit Bhayani released an in-depth explainer on Kafka's exactly-once delivery guarantee.
- Kafka achieves exactly-once via a 3-layer solution, each layer solving one segment of the distributed systems problem; the talk aims to build a mental model transferable to other systems you design.
- Key catch most engineers miss: exactly-once only covers Kafka itself — once your consumer writes to a database or calls an external API, you're on your own.
- Aimed at engineers working with Kafka or distributed systems.
More from Infra
- KV caching: the fundamental optimization behind autoregressive LLM inference — alec_helbling · 2026-09-04
- WSJ: Data centers are a "lottery win" for workers in Richland Parish, Louisiana — robleclerc · 2026-09-04
- No orchestrator, no MCP: 4 peer agents on a gossip mesh research the web and deliver to Slack — Trainer_Intelligent · 2026-09-04
- DLSS 5 ships with NBA 2K27: costs half your 4K frame rate, worth it — ryanshrout · 2026-09-04
- Kastard: Edit ComfyUI Workflows Locally, Auto-Sync Models to RunPod GPUs — spacebearbug · 2026-09-04
- Running Qwen3.8 Flash NVFP4 on a single DGX Spark: 1M context at 37 tok/s — BLUECOW009 · 2026-09-04