The classic meme strikes again: Schmidhuber did it in 1991
arthurcolle · x · 2026-11-03
SchmidhuberAI dismissed a recent work as old hat, noting the neural fast weight programmers did it in the 1990s—including the 1991 unnormalised linear Transformer. arthurcolle took the meme to its logical extreme: new architecture? Schmidhuber, 1991. LLM editing its own weights? Fast weight programmers, 1991. Even a McDonald's drive-thru worker remembering orders is just LSTM—there's a PDF. He jokingly calls Schmidhuber an all-encompassing being who published the inner workings of your subconscious in workshop proceedings nobody can find.