Schmidhuber: AI weight editing is 'old hat' from his 1990s fast weight programmers
SchmidhuberAI · x · 2026-11-03
Responding to the recent Weight-Space Programming hype about LLMs reading/writing neural network weights, Jürgen Schmidhuber calls it 'an old hat,' noting this is exactly what neural fast weight programmers did in the 1990s — including the 1991 unnormalized linear Transformer — and links to his overview of the original papers.
More from Models
- Rumor: OpenAI's Astra may already be routing some users to a GPT-6.2 model — kimmonismus · 2026-11-03
- Yacine: the bitter lesson is why smaller models will win — they scale better and parallelize — yacineMTB · 2026-11-03
- Yacine predicts smaller models will start outperforming bigger ones, citing the bitter lesson — yacineMTB · 2026-11-03
- Claude desktop quietly ships a Wellbeing panel with break reminders and quiet hours — rudrank · 2026-11-03
- Matt Pocock: Widely panned Opus 4.7-5 was 'SOTA enough' for me on £180/mo CC Ultra — mattpocockuk · 2026-11-03
- Mistral Large 4 builds real-time 3D tracker for 19,000 satellites — MistralAI · 2026-11-03