Cloudflare 用数学优化一致性哈希,全球再省超100TB内存
Cloudflare Blog · rss · 2026-09-19
- Cloudflare engineers traced unexpectedly high memory usage in their internal load balancer, Pingora Backend Router, to the pingora-ketama consistent hashing library.
- The post walks through how consistent hashing maps servers and tasks onto a shared number line, and why hash randomness makes per-server ranges uneven: with 100 servers, the coefficient of variation is 99%.
- Using 160 hash points per server (the NGINX/Pingora default) drops the variation to 8%, and the ketama algorithm allows weighting allocation by disk capacity.
- Optimizing the algorithm's math and Rust implementation reclaimed over 100TB of RAM globally, on top of 100TB saved by the DNS team last month.
「Infra」频道最新
- AI Infra 峰会访谈：Penguin 与 Astera Labs 押注 CXL 内存扩展方案 — BenBajarin · 2026-09-19
- 美国芯片业闹人才荒：仅 3% 工科生选芯片，其余都去做 AI — ns123abc · 2026-09-19
- Jev 可替代本地模型做低延迟应用,开源 RLCD 版本可期 — HankYeomans · 2026-09-19
- Arduino Ventuno Q 实测：Hexagon NPU 跑端侧 VLM 推理 — HowDevelop · 2026-09-19
- GPU 涨价殃及 1080ti,本地模型推理速度实测清单流出 — HankYeomans · 2026-09-19
- Bonsai 2 27B 量化版实测:7GB 内存跑出远超同级 3D 生成质量 — Fun-Meaning-6474 · 2026-09-19