mSlideOn: multilingual sparse retriever beats its dense counterpart on most tasks
IgorCarron · x · 2026-10-19
paulomouraj's team released mSlideOn, a multilingual sparse retriever achieving SOTA or competitive results vs dense and sparse baselines. Trained with matched data and distillation, it largely beats the dense mDenseOn: +4.76 on MIRACL, +10.19 on long-context MLDR, +3.24 on MTEB Code (nDCG@10), trailing only -0.70 on English BEIR-15.
Related event: LightOn Open-Sources SOTA Sparse Retrievers SlideOn and mSlideOn(8 posts)→
More from Research
- Forward-only pretraining matches backprop: 3.704 val in 2.5 min on 8×H100, no autograd — tensorqt · 2026-10-20
- NeurIPS 2026 paper 'Intelligence per Watt' measures on-device AI efficiency across 1M queries — HazyResearch · 2026-10-20
- Cohere Labs talk: Goodfire's Matthew Kowal on interpretability across the model design pipeline — Cohere_Labs · 2026-10-20
- NeurIPS paper: AI models can provably hide arbitrary capabilities in encrypted weight backdoors — MoonL88537 · 2026-10-20
- 26,811-pupil study: AI lifts homework scores in China but hurts exam performance — Dr_Alex_Crimi · 2026-10-20
- Dev post-trains Gemma 4 E2B into a decision model, 20x faster and beats local rivals — andrew_n_carr · 2026-10-20