ARC-AGI-3 is now saturated, prompting calls for new benchmarks ASAP
kimmonismus · x · 2026-09-04
Quoting gdb's announcement that arc-agi-3 is now saturated, kimmonismus draws the lesson that the community needs new benchmarks as soon as possible — frontier models have outpaced the benchmark's ability to differentiate capability.
More from Models
- Ethan Mollick: Treat Fable and Astra class models like an outside team, not an intern — emollick · 2026-09-04
- User observes newer model's safety classifiers appear far more lenient, suspects thoughtcrime training — repligate · 2026-09-04
- Gemini Live gains Google Workspace connectors for Gmail, Keep and Docs — testingcatalog · 2026-09-04
- As GPT-6 Astra Launches, Redditors Recall Their Personal "THE Moment" With AI — Sharp_Caregiver_1534 · 2026-09-04
- 'Astra proves how wrong I was': insider revises his skepticism on AI computer use — sandersted · 2026-09-04
- Unverified: OpenAI said to launch GPT-6 Astra, trained on 100k GPUs, claimed as AGI — AI寒武纪 · 2026-09-04