Study: privileged references add little to on-policy self-distillation beyond distillation itself

NationalUniversityofSingapore · hf · 2026-09-18

This paper isolates what privileged references actually add to on-policy self-distillation (OPSD). Using AMPLE-Math—5,319 math problems with six reasoning views sharing the same answer—the authors show reference-free distillation accounts for most of Qwen3-1.7B's gains; extra reference benefit is modest in Qwen and worth only 2 points in SmolLM3-3B at step 50. Gains depend on the student actively training, and swapping short direct-response rollouts for thinking-enabled ones turns gains into losses. OPSD largely improves cross-mode transfer between direct-answer and thinking inference; references matter only insofar as they aid that transfer.

Original post →

More from Research

Research channel →