LightOn Releases Fully Open Multilingual Retrieval Models mDenseOn & mLateOn
antoine_chaffin · x · 2026-07-30
The LightOn team has released mDenseOn and mLateOn, next-generation fully open models for multilingual, long-context, and code retrieval. The release includes 2.8B training pairs and 16.3M fine-tuning samples, along with the training code.
The models demonstrate that the English frontier recipe can be generalized to multilingual scenarios through translation and late interaction, proving the effectiveness of the translate-train paradigm.
Related event: LightOn Open-Sources Multilingual Retrieval Models mDenseOn and mLateOn(18 posts)→
More from Models
- Reflection's Beam, a 501B-parameter open MoE model with 1M context, lands on Hugging Face under Apache 2.0 — QGallouedec · 2026-10-16
- Why are sub-15B open models so rare now? Labs seem to have settled on 24-27B minimum — Hot_Example_4456 · 2026-10-16
- User spots model openly generating "ideal responses" to train other models — liminal_bardo · 2026-10-16
- Reflection's 501B MoE Beam hits 463 tok/s on 8x GB200 with NVFP4 at day 0 — zhyncs42 · 2026-10-16
- Gemma 4 31B QAT on one 24GB card: 46 tok/s plain, ~80 with draft model on RTX 4090 — Subject_Poet_3861 · 2026-10-16
- JevBench v1.7.46 leaderboard: new d1-ultra tops 32 API systems at 76.1 composite — airesearch12 · 2026-10-16