Cloudflare Saves Another 100TB of RAM by Shrinking a Consistent Hash Ring
DanielLockyer · x · 2026-09-19
Cloudflare's performance team found its Pingora Backend Router was hogging memory via the pingora-ketama consistent-hashing library. The last 90,000 hashes per server were buying just a 0.7% load-balance improvement — so they shrank the hash ring and reclaimed over 100TB of RAM globally, on top of 100TB saved by the DNS team last month. A lesson in math-driven engineering tradeoffs at scale.
More from Infra
- Tesla starts 2.8 GWh GREEN TURTLE battery project in Belgium with 640 Megapacks — XFreeze · 2026-09-19
- wllama V3 ships WebGPU, multimodal and tool calling for in-browser llama.cpp inference — ngxson · 2026-09-19
- openjev runs open LLMs locally in the browser via wllama (llama.cpp WebGPU) — ngxson · 2026-09-19
- YC Paper Club hosts Alternative Compute Paradigms event: optical CPUs, neuromorphics, bio GPUs — ycombinator · 2026-09-19
- How did AMD Ryzen get 50% faster in two years? — ibobev · 2026-09-19
- AI infra market self-correcting: fake data-center projects filtered out, says weekly thesis — xtbot · 2026-09-19