GPT-6-Astra-Max hits 62.7% on ARC-AGI-3, up from 0% six months ago at $26k per run
BrennusSokol · reddit · 2026-09-26
A Reddit user followed up on a six-month-old RemindMe: back on March 25, no model scored even 1% on ARC-AGI-3, and a commenter asked whether 75% at $2 would ever happen.
Six months later:
- GPT-6-Astra-Max scored 62.7% with no harness, though at a cost of about $26,100 per run.
- With a lightweight memory adapter the benchmark is effectively saturated, still at $17k+; the adapter preserves opaque reasoning state between requests and uses compaction for longer conversations, letting the model reuse prior work instead of reconstructing it.
- Citing Epoch AI's research on plunging reasoning prices, the author argues models will beat ARC-AGI-3 cheaply soon if the trend holds.
More from Models
- LLMs are most confident where they should hedge — biology lacks the checker code has — anshulkundaje · 2026-09-26
- Bio papers never deliver what abstracts claim — a worse substrate for LLMs — anshulkundaje · 2026-09-26
- Anthropic and OpenAI shipped cheaper models 101 minutes apart — altryne · 2026-09-26
- ImageJevBench: image decision benchmark ranks top models, full eval costs $0.02 — airesearch12 · 2026-09-26
- Gemini 4 Pro Spotted in AI Arena: Leak Claims Google's Comeback Is Coming — mark_k · 2026-09-26
- Even OpenAI's $600 plan rate-limits users, and a pricier Codex 'Pro Max' tier is rumored — khanp4397 · 2026-09-26