LightOn ships 16.3M training pairs and full code alongside SlideOn models
tomaarsen · x · 2026-10-20
LightOn also open-sourced the training data and code: 16.3M query-positive pairs across nine natural languages plus code, with cross-encoder teacher scores. The release includes both SAE initializations and the final retrieval models.
Related event: LightOn Open-Sources SlideOn Sparse Retrievers at 174M/339M, Claiming SOTA(23 posts)→
More from Models
- US open-weights models jump in a week: Meta Muse Spark Open hits 38.9, Reflection's Beam 1.0 lands at 30.3 — ArtificialAnlys · 2026-10-20
- Ex-Google expert: data center capacity and electricity, not GPUs, are the real AI bottleneck — RihardJarc · 2026-10-20
- LLM citations vary run-to-run for the same prompt — so how valid are citation-overlap studies? — lilyraynyc · 2026-10-20
- ElevenLabs launches Eleven Realtime: speech-to-speech that talks in half a second and reasons — lukeharries · 2026-10-20
- nrehiew_: open-weight models are commodity-priced — don't even ask what OpenAI/Anthropic charge — nrehiew_ · 2026-10-20
- Gemini 4 builds a 3D periodic table synced to Tom Lehrer's 'The Elements' — GoogleDeepMind · 2026-10-20