Meta's ZGateway proxy cut ZippyDB per-host connections by 97-98% with just 6% compute overhead
Meta_Engineers · x · 2026-09-14
Meta details ZGateway, the stateless proxy tier in front of ZippyDB, its most widely used key-value store serving 1B+ ops/sec. Direct access from 1M+ client hosts created an unbounded TLS connection mesh, wasting CPU and causing OOM crashes during reconnection storms. The proxy decoupled the fleets, dropping per-host connections 97-98% at 6% compute overhead, and enables admission control, load balancing, cross-region resilience, and richer operations.
More from Infra
- Your AI agent would cost 260% more without prompt caching, Arena data shows — arena · 2026-10-30
- Nebius runs auction-driven GPU pricing, lifting rates ~20% amid tight supply to 2028 — BenBajarin · 2026-10-30
- macOS update silently re-adds eMudhra root certs users had removed — steipete · 2026-10-30
- Bittensor's Terza Inference routes one API across miners' models on subnet 103 — const_reborn · 2026-10-30
- SGLang Summit 2026 sells out sponsor booths and Full Passes ahead of Nov 12–13 event — ying11231 · 2026-10-30
- OpenRouter rebuilds provider routing: 46% fewer capacity errors, 16.9% faster TTFT — steipete · 2026-10-30