Schmidhuber revives the open-source distillation fight with a 1991 origin claim
zephyr_z9 · x · 2026-07-23
A quoted post from Jürgen Schmidhuber argues that open-source models are distilling knowledge that commercial companies had already distilled from the internet for free. He also claims he published distillation research in Europe back in 1991, before the idea was copied in the US and China. The post is mainly a reaction in the open-source-vs-commercial AI debate, plus a historical claim about the origin of distillation.
More from AGI Musings
- Researcher warns sophisticated activation steering could create sleeper agents without touching weights — teortaxesTex · 2026-10-26
- CS professor: don't hide your AI use from future employers, lead with it — lemire · 2026-10-26
- Engineer: AI-cheap engineering will change which manufacturing jobs get a yes — burhop · 2026-10-26
- FixItBench: the joke benchmark where robot-agent teams race to repair electron microscopes — teortaxesTex · 2026-10-26
- Instructor advice: record and save all your teaching materials for future AI use — prof_g · 2026-10-26
- Jason Furman: Building Econvitals pre-AI would need ~50 people, 3 years, $20M — HarrySurden · 2026-10-26