Sequence-level supervised learning for AR LMs is fundamentally flawed, Google team shows

mblondel_ml · x · 2026-11-17

Mathieu Blondel and colleagues (Google DeepMind) released an arXiv paper studying whether sequence-level losses can replace teacher forcing to fix exposure bias in autoregressive LMs.

Key findings:

Conclusions: teacher forcing remains the de facto strategy; on-policy distillation better addresses exposure bias but needs a teacher; sequence-level training is still best done with RL plus a reward function or model.

Related event: DeepMind paper proves sequence-level supervised losses for autoregressive models can be fundamentally flawed(5 posts)→

Original post →

More from Models

Models channel →