LightOn Open-Sources 149M Param Retrieval Models Achieving SOTA

antoine_chaffin · x · 2026-07-31

LightOne released DenseOn and LateOn, fully open-source dense and late-interaction retrieval models. The recipe achieves SOTA performance in multilingual, long-context, and code search tasks with only 149M parameters, demonstrating strong generalization.

Related event: LightOn Fully Open-Sources Multilingual Retrieval Models and 2.8B Training Pairs(15 posts)→

Original post →

More from Models

Models channel →