Meta's ZGateway proxy cut ZippyDB per-host connections by 97-98% with just 6% compute overhead
Meta_Engineers · x · 2026-09-14
Meta details ZGateway, the stateless proxy tier in front of ZippyDB, its most widely used key-value store serving 1B+ ops/sec. Direct access from 1M+ client hosts created an unbounded TLS connection mesh, wasting CPU and causing OOM crashes during reconnection storms. The proxy decoupled the fleets, dropping per-host connections 97-98% at 6% compute overhead, and enables admission control, load balancing, cross-region resilience, and richer operations.
More from Infra
- Sandbox tip: bake dependencies into the image instead of pip-installing at runtime — xeophon · 2026-09-14
- US's No.2 law firm Latham & Watkins builds in-house AI stack with Nvidia servers — ayushtweetshere · 2026-09-14
- Oracle Cuts Double-Digit % of Some Teams While Hiring Aggressively for Data Centers and AI — mkheck · 2026-09-14
- Running Two Models Across Strix Halo + r9700 Hits OOM: Full Config Shared — El_90 · 2026-09-14
- Musk: AI will be 99% of SpaceX's value within four to five years — XFreeze · 2026-09-14
- Weaker enterprise HBM demand could finally normalize DRAM and NAND pricing, argues analyst — eyishazyer · 2026-09-14