Schmidhuber says open-source models should distill what commercial labs distilled for free
SchmidhuberAI · x · 2026-07-24
- Schmidhuber argues that open-source models should be able to distill what commercial companies have distilled from the web for free.
- He says he published distillation ideas for free in Europe in 1991, and that the work was later copied in the US and China.
- The post is framed as a broader debate about who gets to benefit from model distillation and the history of the technique.
More from AGI Musings
- US chases AGI dominance while China, EU and ASEAN treat AI as public infrastructure — BubblyExtent1693 · 2026-10-27
- Lab monkeys at $30-80K each: a 4-year breeding cycle is the real preclinical drug bottleneck — zebird0 · 2026-10-27
- CJR: journalists should stop hyping AI's supposed humanity — just say 'rogue' — ShakeelHashim · 2026-10-27
- PhD applicant emails up 4x YoY due to AI — writing without AI now makes you stand out — AI4Code · 2026-10-27
- Weil's collapse shows BigLaw dies from eroding belief, not a broken business model — jkubicki · 2026-10-27
- All 8 Transformer paper authors left Google, and rival labs captured most of the frontier value — signulll · 2026-10-27