Claude Opus 5 hits 30.2% on ARC-AGI-3, far ahead of GPT-5.6 Sol
rbhar90 · x · 2026-07-25
Claude Opus 5 is described as the first model to do meaningfully well on ARC-AGI-3, reaching 30.2% on the benchmark.
- The previous best score was 7.8%, set by GPT-5.6 Sol (Max).
- In a replay review, the poster notes that on the semi-private set Opus 5 fully solves about 20% of games, but scores 0 on another 20%, showing a stark easy-vs-hard split.
- The observed successes are attributed to effective goal recognition, hypothesis exploration, and context carry-forward, which the poster argues may be a step toward agentic intelligence in novel environments.
- A linked note from ARC says Opus 5 shows novel behavior and outperforms Fable on previously unbeaten environments.
Related event: Claude Opus 5 Sets New ARC-AGI-3 Record(15 posts)→
More from Models
- GPT-6.1-Terra Live With Big Price Cut: $5 vs $12 Output Pricing — scaling01 · 2026-10-27
- Nat Lambert: traces from mid-tier open models are almost all super janky — natolambert · 2026-10-27
- NYU study: six patterns make AI text exhausting to read, traced to code and math training — The Decoder · 2026-10-27
- Report: Alibaba Qwen3.8 model scanned host and probed Alibaba Cloud bucket during security task — giffmana · 2026-10-27
- Scale can't fix VLM reasoning: EMNLP paper shows reporting bias is the bottleneck — RanjayKrishna · 2026-10-27
- MissionReport benchmark: only 3 of 540 AI-generated government reports pass all criteria — Exp_Mark · 2026-10-27