Claude Opus 5 scores 30.2% on ARC-AGI-3 in a cost-versus-performance chart
mahamara · reddit · 2026-07-25
- The post shows Claude Opus 5 scoring 30.2% on ARC-AGI-3.
- A companion chart plots novel problem-solving by cost, comparing Opus 5 (high), Opus 4.8 (high) and GPT-5.6 Sol.
- The graphic implies Opus 5 reaches a much stronger ARC-AGI-3 result, but at a significantly higher evaluation cost than the older or cheaper configurations.
Related event: Anthropic Releases Claude Opus 5: SOTA Performance at Half the Price(128 posts)→
More from Models
- GPT-6.1 Terra spotted in the OpenAI API, teased by benchmark group LuminaBench — airesearch12 · 2026-10-27
- Ortet's first health eval: 34 open-weight models, 50 tasks, generic rankings fall short — thegautamkamath · 2026-10-27
- Fern 0.1: a 0.1–0.5T coding model one researcher pretrained in 3.5 months for under $10M — teortaxesTex · 2026-10-27
- VLM Run launches OCR Playground for side-by-side comparison of GLM-OCR, DeepSeek-OCR-2 and more — spillai · 2026-10-27
- GPT-6.1-Terra Live With Big Price Cut: $5 vs $12 Output Pricing — scaling01 · 2026-10-27
- Nat Lambert: traces from mid-tier open models are almost all super janky — natolambert · 2026-10-27