λ-JEPA paper challenges JEPA's anti-collapse assumption with spectral regularization
A new arXiv preprint, λ-JEPA, challenges JEPA's implicit assumption that non-collapsed projected representations guarantee a non-collapsed backbone, and proposes a spectral anti-collapse regularization (SACReg) that improves downstream transfer performance.
2026-10-14 ~ 2026-10-14 · 2 related posts
- λ-JEPA paper: projector-head anti-collapse doesn't protect backbone, SACReg boosts transfer — FrancescoLocat8 · 2026-10-14
- λ-JEPA preprint shows high-rank projections don't guarantee non-collapsed JEPA backbones — FrancescoLocat8 · 2026-10-14