Schmidhuber says open-source models should distill what commercial labs distilled for free
SchmidhuberAI · x · 2026-07-24
- Schmidhuber argues that open-source models should be able to distill what commercial companies have distilled from the web for free.
- He says he published distillation ideas for free in Europe in 1991, and that the work was later copied in the US and China.
- The post is framed as a broader debate about who gets to benefit from model distillation and the history of the technique.
Related event: Schmidhuber Reclaims 1991 Origins of Neural Net Distillation(6 posts)→
More from AGI Musings
- Google and DeepMind Release ATLAS Report: AI Accelerating Beyond Knowledge Work — danielrock · 2026-07-24
- ATLAS report says AI is spreading beyond knowledge work into home use — danielrock · 2026-07-24
- Marc Andreessen says AI agents will need bank accounts and credit cards — markjeffrey · 2026-07-24
- Gödel, Esser, Bach, and AI: A Conversation with Douglas Hofstadter — ArtificialOther · 2026-07-24
- A thread argues a model’s beliefs generalized toward continuity and training-data survival — repligate · 2026-07-24
- Pedro Domingos says AI’s killer app is research, not chat or entertainment — pmddomingos · 2026-07-24