Cloudflare's Zstandard cache transcoding could save petabytes of storage
arpit_bhayani · x · 2026-09-03
A Cloudflare intern-built prototype called Cache Transcoding encodes cache-eligible responses with Zstandard inside Pingora, keeping them compressed on disk and across tiered-cache datacenter transfers until just before serving.
- Motivated by exploding RAM/HDD prices; eligible assets shrink to 1/3 on disk in initial tests
- Small CPU increase on the origin-facing proxy trades for petabytes of effective cache capacity and inter-DC bandwidth savings
- Encode once at write time; savings recur on every read
Related event: Cloudflare's zstd Cache Transcoding Could Save Petabytes of Storage(2 posts)→
More from Infra
- CPU vs GPU vs TPU vs NPU vs LPU: how 5 chip architectures trade flexibility for AI speed — Roger_M_Taylor · 2026-09-03
- llama.cpp lands three Metal MoE PRs, decode jumps from 65.6 to 73.9 tok/s — predatar · 2026-09-03
- Ex-Tesla SVP Explains How a Single Silicon Carbide Device Can Block 10,000 Volts — wandb · 2026-09-03
- Microsoft Azure Publishes Analysis on the Economics of Agent Optimization — adnan_hashmi · 2026-09-03
- Sovereign AI's water problem: a 1,024-GPU UAE cluster could drink 30M+ liters a year — Arc_bong · 2026-09-03
- Where to learn LLM inference? Redditor seeks an 'HN for inference' — metalvendetta · 2026-09-03