Multi-domain on-policy distillation lets one model learn many skills at once
helloiamleonie · x · 2026-09-25
Leonie explains MOPD (multi-domain on-policy distillation) used in LFM2.5 training: extending on-policy distillation to multiple teachers so the student model learns different skills simultaneously, rather than sequentially. It's the key step that merges specialized teachers' abilities back into a single checkpoint.
More from Research
- Sakana AI × Pathway Post-Transformers lecture on AI and the brain now online — kaixhin · 2026-11-11
- Defending METR: public data can't second-guess its AI speedup findings — peterwildeford · 2026-11-11
- Adversarial RL envs for backdoor insertion vs. detection: where does it converge? — DimitrisPapail · 2026-11-11
- DiffusionEngine: an open-source modular PyTorch DDPM framework seeking contributors — Euphoric-Incident-93 · 2026-11-11
- UniPath (NeurIPS 2026): adaptively coordinating understanding and generation in one model — jindong_wang92 · 2026-11-11
- Versor pitches real2sim2real: robotics sim needs physical dynamics, not just visuals — abhishekunique7 · 2026-11-11