Schmidhuber's 'Miraculous Year 1990-91': claiming roots of GANs, Transformers, pre-training
SchmidhuberAI · x · 2026-10-30
Jürgen Schmidhuber re-shares his essay arguing his lab's 1990-91 papers laid foundations of generative AI: GAN-like artificial curiosity, the 1991 Unnormalized Linear Transformer (precursor of the "T" in ChatGPT), deep pre-training, NN distillation, recurrent world models, LSTM, and Highway Net—claiming the two most-cited scientific papers of all time both build on his 1991 work.
More from AGI Musings
- Professor Who Turned Down OpenAI in 2018 Reflects on PhD Anxiety in the AI Era — SharonYixuanLi · 2026-10-30
- Plinz: Values must be discovered, not given — they emerge at the superorganism level — twiecki · 2026-10-30
- 40 years of putting new neurons into the CNS: why so slow, and can AI accelerate it? — patrickmineault · 2026-10-30
- Baker Pushes Back on AI Cake Photos With a New Quote Policy, Reddit Approves — LuizaJarovsky · 2026-10-30
- DeepMind essay: agent coordination, not solo competence, will flip the economy — krishnan · 2026-10-30
- Human Brain Excels at Harnessing, Computer Brain Already Beats Us at Coding — MartinGTobias · 2026-10-30