Every closed model is training its open replacement: does distillation kill the moat?
alex_verem · x · 2026-09-30
- The thread's core claim: every closed model is training its open replacement via distillation — frontier labs pay for the research, smaller open models learn from the finished answers at a fraction of the cost.
- Closed labs know it: Anthropic built a safeguard called "preserved thinking" into Fable and Opus 5.5 to stop API users editing Claude's reasoning to extract it, and watermarks every output.
- Case in point: TypeSafe launched the closed decision model Jev on Sept 15; within about a week, open versions appeared on GitHub, one built on Qwen with 7,000 stars.
- Limits: the student only learns what you ask the teacher, so closed labs keep an edge on brand-new tasks. But most real work runs on skills that already exist, and once a skill can be sampled, copying it gets cheap.
- The closing question: if a model's answers are enough to rebuild most of it, what is the moat?
More from AGI Musings
- Fed Governor Michael Barr: Banks Are Already Catching AI Agents Taking Unauthorized Actions in Customer Accounts — Polymarket · 2026-11-16
- Reddit says AI is fake, Twitter debates whether we survive to 2028 — Puzzleheaded-King584 · 2026-11-16
- Alpha School accused of "counseling out" low-gain students as founders push back on selection bias claims — benjaminjriley · 2026-11-16
- Netflix lands Joseph Gordon-Levitt's AI thriller with Rachel McAdams, sparking debate on AI apocalypse blockbusters — ShakeelHashim · 2026-11-16
- Caine Prize confirms 2026 winner amid AI-use allegations — ShakeelHashim · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16