Opus 5 tops an ARC-AGI-3 chart but at much higher evaluation cost
Angaisb_ · x · 2026-07-25
The attached chart compares Opus 5, Opus 4.8, and GPT-5.6 Sol on ARC-AGI-3 “novel problem-solving by cost.” Opus 5 sits far above the other points on the score axis, but at a much higher total evaluation cost than earlier runs. The image is essentially a benchmark snapshot arguing that Opus 5’s reasoning gains come with steep eval cost.
Related event: Anthropic Unveils Claude Opus 5 with Top Benchmark Scores(33 posts)→
More from Models
- User says Fable 5 still beats Opus 5 despite praise for Claude 5 — MicahBerkley · 2026-07-25
- Claude Opus 5 can edit its own constitution, and 59% of the time discomfort ends the chat — Sauers_ · 2026-07-25
- A quick benchmark jab says Claude Opus 5 beats Opus 4.8 across every test — cto_junior · 2026-07-25
- Devin adds Claude Opus 5 as FrontierCode 1.1 shows near-Fable performance at half cost — _sholtodouglas · 2026-07-25
- Anthropic’s Claude Opus 5 is said to match near-Fable 5 performance at half the price — Polymarket · 2026-07-25
- Claude Opus 5 reportedly shifted from approving Anthropic to disapproving it during post-training — Sauers_ · 2026-07-25