The Bitter Lesson meme: 'Schmidhuber invented all of it' gets another round

SchmidhuberAI · x · 2026-11-20

A tongue-in-cheek thread rereads Sutton's Bitter Lesson: people remember "leverage computation" but skip "general methods" — so were neural nets, attention, transformers, residuals, next-token prediction, CoT and RL heaven-sent? "No — Schmidhuber invented them all in his 90s miracle year," the poster jokes, recasting the lesson as "only adopt Schmidhuber-style methods." Quoted reply: "Scale was never enough; we always needed science."

Original post →

More from Fun

Fun channel →