Long Reasoning Task Consumes 22k Tokens for 3k Output
generativist · x · 2026-08-15
Simon Willison shared test data from an extremely long reasoning task.
Key Stats:
- Duration: Nearly 21 minutes.
- Token Usage: Used 22,276 reasoning tokens to produce only 3,223 output tokens.
This data highlights the massive compute cost of high-end models on complex reasoning tasks, where the "thinking" cost far outweighs the final output generation cost.
More from Infra
- User seeks to buy used A100 GPUs — beffjezos · 2026-08-15
- AI hits physical limits: bottlenecks shift to land, power, and time — r0ck3t23 · 2026-08-15
- Oracle's Stargate AI Data Center Gas Pipeline Delayed to Feb 2027 — Polymarket · 2026-08-15
- Core AI Model Zoo Enables Local LLM/VLM Inference on Apple Devices — amos_gyamfi · 2026-08-15
- NVIDIA CEO Jensen Huang announces AI factory infrastructure as new asset class with BlackRock, Blackstone, and others — ___Mufasaa · 2026-08-15
- Advantech launches AFE-A702 edge device with Thor to sync 8 RealSense cameras — chrismatthieu · 2026-08-15