Schmidhuber says open-source models should distill what commercial labs distilled for free
SchmidhuberAI · x · 2026-07-24
- Schmidhuber argues that open-source models should be able to distill what commercial companies have distilled from the web for free.
- He says he published distillation ideas for free in Europe in 1991, and that the work was later copied in the US and China.
- The post is framed as a broader debate about who gets to benefit from model distillation and the history of the technique.
More from AGI Musings
- Cohere Labs launches interactive tool mapping which tasks of 178 occupations AI can automate — Cohere_Labs · 2026-09-11
- AI researcher on SkyNews flags concerns over inequality, power and criminal misuse — schwarzjn_ · 2026-09-11
- VC compares AI doom rhetoric to pandemic-era fear messaging — StewartalsopIII · 2026-09-11
- Anthropic Insiders: Not Everyone at the Lab Believes in High p(doom) — anpaure · 2026-09-11
- Could 10k agents discover learning methods beyond backprop, or just tweak existing ones? — SeunghyunSEO7 · 2026-09-11
- AI companionship dissolves the friction real intimacy needs, warns long-form thread — YogeshMalik · 2026-09-11