Sequence-level supervised learning for AR LMs is fundamentally flawed, Google team shows
mblondel_ml · x · 2026-11-17
Mathieu Blondel et al.'s arXiv paper thread (full summary in the first post): teacher forcing causes exposure bias, but the two natural sequence-level losses (greedy decoding and AR sampling based) are provably unbounded below; a stop-gradient variant yields a valid but high-variance moment matching direction. Conclusions: teacher forcing stays, OPD is better but needs a teacher, sequence-level training remains RL's job.
More from Research
- Zuse: decision models for 27 European languages hit 87.5% accuracy at 27B — bineric · 2026-11-17
- Copenhagen postdoc chance at biomaterials × machine intelligence, deadline Dec 6 — _onionesque · 2026-11-17
- $1.1M Templeton grant funds Global Virtues Atlas of moral beliefs for AI alignment — MohammadAtari90 · 2026-11-17
- Dev proposes swarm of specialist diffusion models for code where invalid syntax is unrepresentable — SubtleGradient · 2026-11-17
- Economists warn peer review is collapsing under 99% AI-generated papers and referee reports — Afinetheorem · 2026-11-17
- Meta's Self-Improving Memory: agents discover their own memory skills and distill them into weights — jaseweston · 2026-11-17