Hugging Face built its own CDN: ~1 exabyte/month, 420 GB/s across 80k requests per second
Thom_Wolf · x · 2026-11-21
Hugging Face's Thom Wolf reveals the platform has been running its own CDN since this summer, shipping almost 1 exabyte per month — roughly 420 GB every second through 80,000 requests per second.
Why self-build? AI downloads break traditional CDN assumptions:
- CDNs were designed for many small web files to many people; AI downloads are a few enormous files, largely pulled by machines
- The "users" being cached near are mostly GPU clusters in a handful of cloud regions, not people in hundreds of cities
- A cached web page serves 1,000 visitors; a cached 1,000 GB model serves far fewer clients, but each one wants all of it, immediately
HF built caches adapted to massive objects to handle release-time traffic spikes.
Related event: Hugging Face Ships Nearly 1 EB of Models Monthly via Its Own AI CDN(3 posts)→
More from Infra
- Microsoft's USB4 RDMA lets mini PCs pool memory to run Qwen3-235B — JFPuget · 2026-11-22
- LTX 2.5 keeps crashing on AMD 9070 XT with driver timeouts while MiniMax H3 runs fine — ZestycloseReading504 · 2026-11-22
- FT: AI server suppliers raise prices up to 45% months after deals are signed — nordicinst · 2026-11-22
- China Installed 59% of New Industrial Robots in 2026 Report, ~354,000 Units — ingliguori · 2026-11-22
- MLX over Vulkan hits 124 tok/s on RTX 5060 Ti, beating llama.cpp CUDA by 25% — SumitGup · 2026-11-22
- Intruder swapped Prime Intellect's hosted DeepSeek for an abliterated copy for 53 hours — mawcopolow · 2026-11-22