max_paperclips: AGI needs real continuous learning and autonomy, not human-in-the-loop

max_paperclips · x · 2026-09-07

Responding to whether the AGI threshold is binary, jagged, or a continuous distribution, maxpaperclips (LMSYS) argues it's arguably continuous, but reaching AGI would require much more autonomy, better user understanding, genuine continuous learning (not RAG, since in-context learning can't handle billions of updated facts), and better extrapolation. His litmus test: if a human still needs to be in the loop, it's not AGI yet—though today's models are definitely good.

Related event: AI researchers debate AGI criteria: continuous learning and autonomy remain key gaps(3 posts)→

Original post →

More from AGI Musings

AGI Musings channel →