Tech Debate: Can Models Be Distilled Using Only API Outputs?
tomekkorbak · x · 2026-07-20
The AI tech community recently debated the exact definition of model distillation on X.
- Core Controversy: Some techies pointed out that "distillation" is now loosely used to mean training solely via API outputs (generated text samples) without needing raw logits data.
- Technical Rebuttal: Developer @migtissera strongly questioned this, arguing that true distillation is impossible using only API outputs. He used this to refute recent accusations that Chinese AI labs boosted their models by "distilling API data," noting that companies like Anthropic even hide reasoning traces server-side, returning only hashes to make reverse extraction harder.
- Community Call to Action: Researcher Ryan Greenblatt called for a definitive article outlining the actual effects of "training on outputs only" and standardizing the use of the term "distillation" when logits are unavailable.
Related event: AI Model Distillation Debate: Normal Tech Evolution or IP Theft?(5 posts)→
More from Research
- Researcher flags unresolved data transparency issues in compositionality evals — najoungkim · 2026-10-27
- Separate Forms from Estimators: Why Steer by Difference of Means When You Can Use SGD? — johnhewtt · 2026-10-27
- EMNLP paper probes why some LLM biases survive rewording while others don't — radamihalcea · 2026-10-27
- Datology webinar: Curation Studio matched top data baselines with under 20% compute — josh_wills · 2026-10-27
- KANLab: an interactive browser playground for Kolmogorov-Arnold Networks — Lukas Niehaus · 2026-10-27
- CMU's LLM2Cert synthesizes stability certificates verified via SMT and Lean — CarnegieMellonU · 2026-10-27