Cloudflare reclaims 100TB of RAM with math and Rust in Pingora
bibryam · x · 2026-09-24
Cloudflare details fixing excessive memory use in its Pingora Backend Router: the open-source consistent-hashing library pingora-ketama was far more memory-hungry than expected, and 32-bit hash collisions could even worsen balance. Reworking the hashing math in Rust reclaimed over 100TB of RAM globally, on top of the 100TB the DNS team shed last month. Rollout kept both ring versions and selected per request to limit cache churn.
More from Infra
- GeoPair: Training-Free Cross-Layer Factorization Hits SOTA in Transformer Compression — MTSAIR · 2026-09-24
- Chose rustpython-parser over tree-sitter after measuring both on real LLM output — SprayPuzzleheaded533 · 2026-09-24
- More compute made one agent 13x faster, another just 4%: agents' bottlenecks are task-dependent — alex_verem · 2026-09-24
- beffjezos claims thermodynamic compute will hit 1 billion pbits next year, mocking quantum's ~100 qubits in a decade — mjdramstead · 2026-09-24
- DeepSeek tests running smaller models on cheap gaming GPUs, per The Information — rohanpaul_ai · 2026-09-24
- NVIDIA DGX Spark sold out at retail as the last Micro Center units go — TheZachMueller · 2026-09-24