Community debates AGI criteria: continuous learning and removing humans from the loop
In early September 2024, community members including LMSYS's maxpaperclips, ChrisGPT, and laoma1255 held a multi-round debate on the criteria for judging AGI.
Confirmed
- maxpaperclips, responding to whether the AGI threshold is binary or continuous, said the path from current models to AGI is roughly continuous, but requires breakthroughs in autonomy, deeper user understanding, genuine continuous learning (not RAG, since in-context learning cannot handle billions of constantly updating facts), and stronger extrapolation; if a human must stay in the loop, it is not yet AGI.
- He also argued the current industry metric—marginal human productivity gain per incremental token spend—should be replaced by a harder but more correct one: how small the loss of marginal utility is when humans are removed from the process.
- ChrisGPT held that intelligence includes acquiring and applying knowledge in specific contexts, that model learning efficiency remains far below humans, and without continuous learning models cannot match humans who work and accumulate experience over years.
- laoma1255 wrote a long rebuttal of the "moving goalposts" claim: standards have not moved; people conflate accumulated skill with true intelligence. Citing Chollet's ARC-AGI stance, he argued intelligence is sample efficiency in acquiring new skills on unfamiliar problems—the missing piece is meta-learning, learning how to learn.
- HanchungLee relayed the debate over measurement: human gains versus losses after removing humans.
Why it matters
- The discussion crystallizes two actionable criteria—genuine continuous learning (distinct from RAG/ICL) and autonomous closed-loop operation once humans are removed—offering a clearer framework for evaluating model progress.
- laoma1255's rebuttal suggests focusing on sample efficiency and meta-learning as the fundamental gap, directly informing next-generation model research directions.
2026-09-07 ~ 2026-09-08 · 5 related posts
Primary sources
- max_paperclips: AGI needs real continuous learning and autonomy, not human-in-the-loop — max_paperclips ·
- Debate on AI metrics: measure marginal utility loss when removing humans, not token-spend gains — max_paperclips ·
- We didn't move the AGI goalposts: the real missing piece is meta-learning — laoma1255 ·
- No continuous learning, no AGI: models can't match years of human expertise — ChrisGPT · 2026-09-07
- [source] max_paperclips: AGI needs real continuous learning and autonomy, not human-in-the-loop — max_paperclips · 2026-09-07
- AGI debate: should AI be measured by productivity gain or by loss when humans leave the loop? — HanchungLee · 2026-09-07
- [source] Debate on AI metrics: measure marginal utility loss when removing humans, not token-spend gains — max_paperclips · 2026-09-07
- [source] We didn't move the AGI goalposts: the real missing piece is meta-learning — laoma1255 · 2026-09-08