Opus 5 appears to improve on ARC-AGI 1 and 2, and may rely on algebraic puzzle solving
herbiebradley · x · 2026-07-25
Herbie Bradley says the Opus 5 system card shows clear gains on ARC-AGI 1 and 2 compared with 4.7/4.8.
He also notes that the system-card description of an ARC-AGI-3-like task sounds like the model learns to turn a visual puzzle into explicit algebra, which he sees as a very trainable strategy. Based on that, he predicts the improvement likely came from a focused research project on these puzzle types, possibly using a data vendor under an exclusivity agreement.
Related event: Claude Opus 5 Sets New ARC-AGI-3 Record(15 posts)→
More from Models
- Engram's random reads don't suit SSDs; CPU-memory over NVLink could serve all 72 GPUs — bookwormengr · 2026-09-11
- Meta's Muse Agent has built-in invite code logic, hinting at free-usage expansion — testingcatalog · 2026-09-11
- Same Echo Maze prompt, three frontier models: all passed visually but shipped the same hidden bug — eyishazyer · 2026-09-11
- Benchmark scores drop from 89% to 19% on new evals — how benchmaxxing breaks leaderboard trust — airesearch12 · 2026-09-11
- ChatGPT tells user their question is too hard and to 'accept dumber answers' — phido3000 · 2026-09-11
- Claude is no longer available for minors as Anthropic rolls out age assurance — Muhammad523 · 2026-09-11