Schmidhuber says distillation was published in 1991 and later copied
tom_doerr · x · 2026-07-23
Jürgen Schmidhuber says a key fun fact about distillation is that it was published in 1991 and later copied by others.
The attached screenshot shows the broader context: he is pointing back to an early paper lineage and contrasting it with later claims in the modern AI boom. The post is mainly a historical reminder about how the technique predates many recent discussions.
Related event: Schmidhuber Claims Neural Network Distillation Dates Back to 1991(3 posts)→
More from Research
- Raji says FAccT papers are heavily cited in NIST, FTC and DOJ AI policy docs — rajiinio · 2026-07-23
- Nature piece says LLMs can forecast social-science experiment outcomes — RobbWiller · 2026-07-23
- Nature paper finds LLMs can predict social-science experiment results — RobbWiller · 2026-07-23
- Researchers open a demo for forecasting social-science treatment effects — RobbWiller · 2026-07-23
- LLM-only pilots cost under $1 and rival ~230-person human pilots — RobbWiller · 2026-07-23
- LLM forecasts were about 2x too large and weaker on field experiments — RobbWiller · 2026-07-23