Meta's Loop Scaling Laws: sparsity and recurrence yield ~2-3x efficiency gains in MoE models

fly51fly · x · 2026-10-02

Meta AI researchers introduce Loop Scaling Laws, the first scaling law jointly modeling recurrence and MoE sparsity alongside model size and data. Key findings:

Related event: Meta Unveils First Scaling Laws for Looped Mixture of Experts(3 posts)→

Original post →

More from Research

Research channel →