AGI debate: should AI be measured by productivity gain or by loss when humans leave the loop?
HanchungLee · x · 2026-09-07
@maxpaperclips argued that to enter AGI territory, we'd need far more autonomy, better user understanding, genuine continuous learning (not RAG, since ICL can't handle billions of updated facts), and stronger extrapolation: "if I need to still be in the loop, it's not AGI yet (although it's definitely a good model)."
@HanchungLee responded with a sharper framing: we currently measure AI by marginal human productivity gain from incremental token spend, but it should be measured by minimizing marginal utility loss when we remove the human from the loop.
Related event: Debate Rages Over What Counts as AGI(4 posts)→
More from AGI Musings
- Reddit debate: should expert corrections to AI outputs count as paid work? — gareth789 · 2026-09-07
- LLMs aren't creating a new intellectual program — they're reviving symbolic AI's old questions — Amichayg · 2026-09-07
- MIT's 13-lecture Society of Mind course by Marvin Minsky is free online — TheMoonMidas · 2026-09-07
- Delip Rao accuses ex-OpenAI's Miles Brundage of dishonest victory-lapping — deliprao · 2026-09-07
- Analyst speculates OpenAI's Astra is a World Model 3.0 after abandoning Sora — teortaxesTex · 2026-09-07
- Journal argues academia structurally selects against creativity — a decades-old consensus — davidmanheim · 2026-09-07