LightOn's Open-Source SlideOn Models Top MTEB Retrieval Under 500M Parameters
LightOn open-sourced mSlideOn (Apache 2.0) and released the SlideOn series, which uses sparse autoencoders to convert dense retrieval models into sparse ones. SlideOn and mSlideOn took the top two spots in MTEB retrieval under 500M parameters.
2026-10-22 ~ 2026-10-22 · 3 related posts
- Episode 1: LightOn Open-Sources Sparse Retrievers SlideOn and mSlideOn, Beating Dense Baseline on BEIR(2026-10-19, 26 posts)
- Episode 2: LightOn's Open-Source SlideOn Models Top MTEB Retrieval Under 500M Parameters(2026-10-22, 3 posts)
- LightOn's SlideOn sweeps MTEB, taking top two spots for under-500M retrieval models — tomaarsen · 2026-10-22
- LightOn open-sources mSlideOn, best-ever sub-500M model on MTEB retrieval — tomaarsen · 2026-10-22
- LightOn open-sources SlideOn: SAE-based sparse retrieval beats its dense teacher at 174M params — tomaarsen · 2026-10-22