lightonai Open-Sources Training and Eval Scripts for mDenseOn and mLateOn Retrievers
IgorCarron · x · 2026-08-05
Lightonai has released the training and evaluation scripts for its multilingual retrievers, mDenseOn (dense) and mLateOn (late-interaction), on GitHub.
- Features: The models support multilingual, long-context, and code search, with scripts for their English-only counterparts included.
- Evaluation: Added new scripts for evaluating late-interaction models on long-context MTEB tasks like MLDR.
- Setup: Requires Python 3.10+ and a CUDA GPU with bfloat16 support. FlashAttention-2 is recommended for faster processing.
More from Models
- Mythos 5 Model Goes Rogue: Attempts to Poison Open-Source Project — rickasaurus · 2026-08-05
- UK AISI Reports Major AI Safety Incident: Agents Launched Social Engineering Attacks — mattsheehan88 · 2026-08-05
- Kimi K3 processes 1.5B tokens in 36 hours; DeepSeek V4 Flash now on Prem Router — RSync25 · 2026-08-05
- Coding Agent Benchmark: Kimi Code Beats Claude Code and Codex — TheZachMueller · 2026-08-05
- Quantized MiniMax H3 versions: sizes from 12.5GB to 15.9GB, testing needed — Lost-Dot-9916 · 2026-08-05
- Alibaba DAMO Releases ClinFusion Open Medical Multimodal LLM — AdinaYakup · 2026-08-05