Looping model loops only middle layers for 1.5-1.9x compute-equivalent gains
The variable-looping model loops only middle blocks for 1.51-1.91x compute-equivalent gains; the released version keeps only a third of training experts, pruned and then distilled with 1T extra tokens.
2026-11-21 ~ 2026-11-21 · 2 related posts