One-Shot OPD: a single query keeps on-policy distillation improving for hundreds of steps
ParshinShojaee · x · 2026-09-04
Following their earlier Rethinking OPD work, the team dug into why On-Policy Distillation works and landed on One-Shot OPD: training on a single query keeps the student improving for hundreds of steps and recovers most of the gains of full-data OPD.
They frame OPD as "data-overfed but algorithm-starved":
- Data: one query already covers most of the states full data would visit.
- Algorithm: the student absorbs less of the remaining gap with each step, so returns diminish.
Related event: Tsinghua's One-Shot OPD Matches Full Distillation with 16 Queries(2 posts)→
More from Research
- Richard Socher: AI could compress a century of scientific breakthroughs into a decade — RichardSocher · 2026-10-21
- Startup Electric Plant builds an AI model to decipher plants' electrical signals — TechCrunch AI · 2026-10-21
- Claude reads the literature to build open human surfaceome atlas, claim by claim — owl_posting · 2026-10-20
- Eval researcher teases guide to subjective-task evals, with a curated resource list — cwolferesearch · 2026-10-20
- IIT Madras article splits LLM memory into five approaches and asks why belief revision is still missing — LimeOptimal539 · 2026-10-20
- Scholar writes AI-assisted book on storytelling values, work nominated for EMNLP best paper — _akpiper · 2026-10-20