Cloudflare Saves Another 100TB of RAM by Shrinking a Consistent Hash Ring
DanielLockyer · x · 2026-09-19
Cloudflare's performance team found its Pingora Backend Router was hogging memory via the pingora-ketama consistent-hashing library. The last 90,000 hashes per server were buying just a 0.7% load-balance improvement — so they shrank the hash ring and reclaimed over 100TB of RAM globally, on top of 100TB saved by the DNS team last month. A lesson in math-driven engineering tradeoffs at scale.
Related event: Cloudflare Saves Another 100TB of RAM by Shrinking Hash Ring(2 posts)→
More from Infra
- NEURA launches Neuron AI, but Europe's Physical AI test is whether the stack matures together — ingliguori · 2026-11-04
- S3-based databases cache in memory and NVMe, making disk vs S3 latency gap smaller than expected — mgill25 · 2026-11-04
- gpu-unlock project claims up to 2x FP16 tensor throughput for RTX 20/30/40 cards — paranoidray · 2026-11-04
- These 10 GPU optimization papers are why your model runs fast today — NandoDF · 2026-11-04
- One prompt to audit cross-region traffic: dev cut trans-Atlantic latency by moving a service — DanielLockyer · 2026-11-04
- SurrealDB 4 launches as multi-model ACID database for the agentic era — Scobleizer · 2026-11-04