The Math: Claiming 100T Tokens/Day Would Need ~580K GPUs
teortaxesTex · x · 2026-08-21
The author runs the unit-economics math on claims of massive daily token throughput. In serious agentic sessions, input+output tokens are under 5% of total processing — he observes 1% on the DeepSeek platform at 0.5-1B tokens/day, so 1T "honest tokens" is just one small cluster.
He further estimates that running a 5.3-scale model at DS-V4 rate (2K tokens/GPU/s at 80 tps) would require 580K GPUs to hit 100T tokens/day — implying the claimed token count likely isn't output tokens, or the number is questionable.
More from Infra
- Cursor's deep dive: why hosting Git repositories at scale is a nightmare — zainhas · 2026-08-21
- CUHK Team Open Sources Libra: 3x Throughput for Agentic Training — jiqizhixin · 2026-08-21
- Open-source x402-cleanweb-agent saves 80% tokens by cleaning web content — EstablishmentTough18 · 2026-08-21
- Pretraining Potential: Coding Agents and the Compute Bottleneck — zeeshanp_ · 2026-08-21
- Moore's Law Fading: Non-Silicon Computing and Novel Architectures to See Capital Influx — MikePFrank · 2026-08-21
- "Why do we need more datacenters? Just write faster kernels" — basedjensen · 2026-08-21