Opus 5 reaches about 30% on ARC-AGI-3 in a cost-versus-skill chart
Dr_Singularity · x · 2026-07-25
The post highlights Opus 5 on ARC-AGI-3 with an attached chart titled “Novel problem-solving by cost.”
Key points from the image:
- Opus 5 (high) scores about 30%
- Opus 4.8 (high) is around the low single digits
- GPT-5.6 Sol appears in the high single digits at a higher evaluation cost
The chart emphasizes the cost-versus-performance tradeoff on a benchmark aimed at novel problem solving, not just standard benchmark completion.
Related event: Anthropic Releases Claude Opus 5: SOTA Performance at Half the Price(128 posts)→
More from Models
- Open Models Match GPT-6 on MedMCQA but Trail 17 Points on Hard Clinical Cases — keunwoochoi · 2026-10-27
- Health-Focused Benchmark Reranks LLMs: Muse Spark Open Jumps from #9 to #1 — keunwoochoi · 2026-10-27
- DeepSeek cut KV cache per token from 389KB to 890B in two years as open-closed gap debate rages — teortaxesTex · 2026-10-27
- GPT-6 Astra controls dexterous hands zero-shot at just 5.2% success in 500 trials — stingning · 2026-10-27
- Unverified: fable 5.5 speculated at 4-5T parameters to outscale 1-3T Opus — haider1 · 2026-10-27
- Kimi K3 Is 'Open' Until You Succeed: License Caps Free Use at $20M Revenue — alex_verem · 2026-10-27