max_paperclips: AGI needs real continuous learning and autonomy, not human-in-the-loop
max_paperclips · x · 2026-09-07
Responding to whether the AGI threshold is binary, jagged, or a continuous distribution, maxpaperclips (LMSYS) argues it's arguably continuous, but reaching AGI would require much more autonomy, better user understanding, genuine continuous learning (not RAG, since in-context learning can't handle billions of updated facts), and better extrapolation. His litmus test: if a human still needs to be in the loop, it's not AGI yet—though today's models are definitely good.
More from AGI Musings
- All 8 Transformer paper authors left Google, and rival labs captured most of the frontier value — signulll · 2026-10-27
- Anthropic's S-1 pledges AI for curing diseases and serving 4.6B underserved patients — petergyang · 2026-10-27
- Goldman finds statistically significant negative link between AI adoption and US employment growth — ben_j_todd · 2026-10-27
- a16z: World-changing tech makes a chaotic entrance — AI agents are following the same path — a16z · 2026-10-27
- NEJM AI on medical education: mastery requires performing without the machine — BraydonDymm · 2026-10-27
- Dev warns abliterated models could wreck software supply chains with 1000+ transitive dependencies — nitarshan · 2026-10-27