Meta Unveils First Scaling Laws for Looped Mixture of Experts

Meta AI's new paper proposes the first scaling laws jointly modeling recurrence and MoE sparsity, showing sparsity yields 3x efficiency gains while looping saves 2x compute, roughly doubling inference efficiency.

2026-10-01 ~ 2026-10-02 · 3 related posts