Chollet: The Test for Human-Level AGI Is Passing ARC-AGI-(n+1) on Release
fchollet · x · 2026-09-30
ARC-AGI creator François Chollet poses the question of how to test human-level generality in AI.
He quotes and endorses researcher Dylan Moore's answer: the "meta-benchmark" is being able to pass ARC-AGI-(n+1) immediately upon release — i.e. a truly general intelligence should instantly adapt to the next, unseen generation of the benchmark rather than just clearing the current one.
Chollet adds that this instant-pass state presumably won't last forever, implying the benchmark will eventually be caught up to.
More from AGI Musings
- Fed Governor Michael Barr: Banks Are Already Catching AI Agents Taking Unauthorized Actions in Customer Accounts — Polymarket · 2026-11-16
- Reddit says AI is fake, Twitter debates whether we survive to 2028 — Puzzleheaded-King584 · 2026-11-16
- Alpha School accused of "counseling out" low-gain students as founders push back on selection bias claims — benjaminjriley · 2026-11-16
- Netflix lands Joseph Gordon-Levitt's AI thriller with Rachel McAdams, sparking debate on AI apocalypse blockbusters — ShakeelHashim · 2026-11-16
- Caine Prize confirms 2026 winner amid AI-use allegations — ShakeelHashim · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16