Agent token usage 14x human, driving massive compute demand
BenBajarin · x · 2026-09-02
Data from OpenRouter reveals that Agent token usage surpassed human usage in February and has since grown to 14 times that of humans. This surge is driven by the multi-turn nature of agentic sessions, frequent tool calling, and context reminders. As models improve at tool and computer usage, Agent compute consumption is projected to outpace human usage by 10x in the next 12 months.
More from Infra
- SGLang Summit sponsors grow from 11 to 36 in one week; Lip-Bu Tan, Lilian Weng to speak — BanghuaZ · 2026-10-18
- Yacine jokes his datacenter KPI is gigawatt-hours: get paged if not burning enough power — yacineMTB · 2026-10-18
- 1.68x inference speedup drops, directly accelerating GRPO post-training — yacineMTB · 2026-10-18
- OpenRouter is only a fraction of the total addressable market, poster argues — sloppenheimer · 2026-10-18
- Developer builds change alerts for LLM prices and retirements across Bedrock, Azure and Vertex — jsandhu0780 · 2026-10-18
- 12.3M tokens in 27 minutes for $0.14: agent session with 99.6% cache hit — teortaxesTex · 2026-10-18