Matryoshka Enables Free Student-Teacher Distillation During Pretraining

nthngdy · x · 2026-08-19

In Matryoshka suites, all submodels are trained in the same process, allowing for free student-teacher online distillation during pretraining. As a result, Matryoshka submodels are much better aligned with each other, benefiting from both nesting and distillation.

Related event: Matryoshka LM Suites: Nested Training Cuts Compute by 36%(8 posts)→

Original post →

More from Research

Research channel →