New Open Multilingual Retrieval Models Launch with Up to 5x Training Speedup
antoine_chaffin · x · 2026-07-31
The next generation of fully open models, mDenseOn and mLateOn, have been released, focusing on multilingual, long-context, and code retrieval while maintaining frontier performance.
Additionally, these models are compatible with the packed-encoders package. For ragged inputs with many pad tokens, developers can simply call pe.pack(model) to achieve up to a 5x speedup in training and a 2x speedup in inference.
Related event: LightOn Open-Sources Multilingual Retrieval Models mDenseOn and mLateOn(18 posts)→
More from Models
- A Little Encouragement Makes a Small Local Model Draw a Stunning Pelican SVG — Fancy-Snow7 · 2026-10-16
- Rapid-MLX 0.16.2 brings NVIDIA Nemotron 3.5 up to 120B to Apple Silicon Macs — kuchaev · 2026-10-16
- "End of Chinese OSS" claim pushed back: open models get license almost automatically — eliebakouch · 2026-10-16
- Opus 5.5 still leads a month later, but open-weight decision models are closing in — airesearch12 · 2026-10-16
- Google restricts Gemini Pro access for Google Plus subscribers, matching free tier — EmergencyLess8861 · 2026-10-16
- Meta releases Muse Spark Open, trained with vLLM-powered RL inference from day one — colinmcnamara · 2026-10-16