LightOn Open Models Top BEIR Leaderboard, Score 100% on New MTEB Transparency Metric
antoine_chaffin · x · 2026-08-03
The MTEB leaderboard recently introduced a new transparency metric to evaluate how open models are regarding their license, training data, paper, and code. AI company @LightOnIO announced that its open-source models achieved a perfect 100% score on this metric and have taken the top spots on the BEIR leaderboard. The author emphasized that while releasing powerful models is cool, providing the community with the tools to reproduce, audit, and enhance them is even better.
Related event: MTEB Adds Openness Metric; LightOn Model Scores Perfectly(2 posts)→
More from Models
- DeepSeek Models Tested: 242 One-shot Outputs Compared — kms_dev · 2026-08-03
- MiniMax H3 Tested: Users Report Censored Video Generation — DaLyon92x · 2026-08-03
- Google AI Mode Becomes Rigid Due to Over-Optimization for Safety and Shopping — Build-your-own-2020 · 2026-08-03
- AI Educator Teams Up with Hugging Face for Open Model Series — HarperSCarroll · 2026-08-03
- Anthropic Investigating Degraded Performance Issue on Claude Sonnet 5 — ClaudeAI-mod-bot · 2026-08-03
- User extracts internal system prompt of Google Gemini — Empty_Paramedic_5957 · 2026-08-03