Schmidhuber backs open-source distillation as a legitimate part of the model lineage
SchmidhuberAI · x · 2026-07-24
The post argues that open-source models should be allowed to distill what commercial companies have already distilled freely from the internet. It also cites a 1991 publication on distillation and says the idea was later copied in the US and China.
The core point is a philosophical one about openness, reuse, and whether today’s model ecosystem should treat distillation as a legitimate part of the research lineage rather than something uniquely proprietary.
More from AGI Musings
- Researcher quits Anthropic, says OpenAI and Anthropic are gambling lives racing to self-improving superintelligence — davidmanheim · 2026-09-11
- Misquoted: Anthropic Staff Warned of Double-Digit Extinction Risk by 2030, Not Dismissed It — davidmanheim · 2026-09-11
- Economist Ben Moll: You Can Model Anthropic's 15% AI GDP Growth, But It Won't Happen — sebkrier · 2026-09-11
- Cohere Labs launches interactive tool mapping which tasks of 178 occupations AI can automate — Cohere_Labs · 2026-09-11
- AI researcher on SkyNews flags concerns over inequality, power and criminal misuse — schwarzjn_ · 2026-09-11
- VC compares AI doom rhetoric to pandemic-era fear messaging — StewartalsopIII · 2026-09-11