Real AI Compute Demand Far Smaller Than It Looks: 99% of OpenRouter Tokens Are Cache Hits

Analyses of OpenRouter data suggest AI compute demand is far smaller than headline numbers imply: all of its DeepSeek traffic could nearly fit on a single GB300 rack, and 99% of its roughly 10 trillion daily tokens are cache hits from agents repeatedly rereading the same conversations.

2026-10-28 ~ 2026-10-29 · 2 related posts

• OpenRouter's entire DeepSeek traffic could run on a single GB300 rack, worth just $6-7M — teortaxesTex · 2026-10-28
• OpenRouter's 10T Daily DeepSeek Tokens Are 95% Cache Hits; One GB300 Rack Could Serve It All — AccBalanced · 2026-10-29