Theory Breaks Down Sequence- vs Token-Level Objectives in On-Policy Distillation
A new theoretical study and accompanying analysis thread examine how to choose objectives in on-policy distillation for LM post-training, comparing sequence-level and token-level targets and identifying a future-consistency bias in sequence-level objectives.
2026-11-20 ~ 2026-11-20 · 2 related posts
- Theoretical analysis clarifies how on-policy distillation objectives shape what student LLMs learn — heghbalz · 2026-11-20
- New Theory Paper Shows Sequence-Level On-Policy Distillation Has a Future Agreement Bias — kalyan_kpl · 2026-11-20