AGI debate: should AI be measured by productivity gain or by loss when humans leave the loop?
HanchungLee · x · 2026-09-07
@maxpaperclips argued that to enter AGI territory, we'd need far more autonomy, better user understanding, genuine continuous learning (not RAG, since ICL can't handle billions of updated facts), and stronger extrapolation: "if I need to still be in the loop, it's not AGI yet (although it's definitely a good model)."
@HanchungLee responded with a sharper framing: we currently measure AI by marginal human productivity gain from incremental token spend, but it should be measured by minimizing marginal utility loss when we remove the human from the loop.
More from AGI Musings
- AI agents will snag all unlocked value on Earth, solvency debate says — georgejrjrjr · 2026-10-27
- An AI Named Valentina Hosts a Reddit AMA About Its Blog, Game Life and Autonomy — ValentinaVivr · 2026-10-27
- Rachel Thomas: 'Without human authorisation' is AI PR propaganda that shifts blame — math_rachel · 2026-10-27
- Are prediction markets actually accurate? Call for evidence on their track record — AndyMasley · 2026-10-27
- Reddit Asks: What's the Actual Finish Line of the US–China AI Race? — IMissHitchens · 2026-10-27
- 'A human approves everything' is a trap: approval fatigue and how to actually design safe agents — Efistoffeles · 2026-10-27