GPT-6.1 Sol jumps from 7.8% to 52.7% on ARC-AGI-3 in 2.5 months
mhmazur · x · 2026-10-01
ARC Prize's mhmazur notes that when he joined in July, the top ARC-AGI-3 score was GPT-5.6 Sol's 7.8%; 2.5 months later, GPT-6.1 Sol scores 52.7% on the same standard harness.
Verified numbers from ARC Prize:
- ARC-AGI-3: 52.7% (standard harness, $7.6K) and 96.4% (provider adapter harness, $4.4K)
- ARC-AGI-2: 94.2%, $0.25/task
- ARC-AGI-1: 98.5%, $0.06/task
Its 96.4% on v3 rivals GPT-6 Astra's 99.9% at 77% lower cost.
More from Models
- Dev Ditches Claude for Long-Running Sessions: Unstable Compacts, 80% of Quota Gone in 3 Days — MaziyarPanahi · 2026-10-01
- Gemini 4 Argon reportedly live as Google's model cadence accelerates, unconfirmed — Dr_Singularity · 2026-10-01
- webAI's 3.6B TwIL-LM3-Pro beats VibeThinker-3B by 35% on formal logic, runs locally in 2GiB — rohanpaul_ai · 2026-10-01
- Quick benchmark: Sol 6.1 inference is nearly 6x slower than Opus despite better token efficiency — RexDouglass · 2026-10-01
- Reddit Users Question AA Intelligence Index After Sonnet 5.5 Outranks Fable 5.1 — Ill_Distribution8517 · 2026-10-01
- Creator uses Opus 5.5 to co-direct a short vignette set in Tokyo — ebbyamir · 2026-10-01