"Hillclimbing Predict-the-Next-User-Message" as RSI: an AI-Circle Joke Resonates

CatAstro_Piyush · x · 2026-10-10

Researcher Arseny Karvonen joked that it would be funny if hillclimbing on "predict the next user message" turned out to be how we finally achieve recursive self-improvement.

The quip highlights an uncomfortable truth about training on user interaction data: the next leap in model capability may come from perfectly fitting human behavior. The joke circulated widely in AI circles.

Original post →

More from Fun

Fun channel →