Agent Arena: Opus Performance Gains Come With Massive Token Spike
arena · x · 2026-08-08
Agent Arena tracks token usage for real-world tasks and found that Anthropic's Opus series saw a significant performance boost (4.7 to 5) alongside a massive increase in token consumption, jumping from 8.5k to 21k (reasoning + output).
Conversely, top GPT models show the opposite trend. Between GPT-5.5 and GPT-5.6-Sol, token usage dropped from 10k to 8k, despite a 1.5pp net performance gain.
More from Models
- Opus 5.5 turns heads with surprisingly polished vertical video demo — FinanceYF5 · 2026-10-16
- Astra 6.1 may arrive before end of month, reads dev's 'we are cooking' tease — haider1 · 2026-10-16
- Open-source OCR model indra-ocr trends on Hugging Face with CPU support — datalab-to · 2026-10-16
- Xiaohongshu's Vela 35B turns anonymized user behavior into supervision, gains +11.5 on VelaBench — AdinaYakup · 2026-10-16
- KOL: No better model than Anthropic's Opus right now, its magic is back — kimmonismus · 2026-10-16
- Users blast Gemini in Chrome's 'draconian' usage caps: memory costs 2-4% per use — North-American · 2026-10-16