Theory Breaks Down Sequence- vs Token-Level Objectives in On-Policy Distillation

A new theoretical study and accompanying analysis thread examine how to choose objectives in on-policy distillation for LM post-training, comparing sequence-level and token-level targets and identifying a future-consistency bias in sequence-level objectives.

2026-11-20 ~ 2026-11-20 · 2 related posts