Kimi K3.1 tops Vals open-weight index as prominent evaluator admits bidirectional forecast miss
teortaxesTex · x · 2026-10-25
Vals AI announced that the newly released Kimi K3.1 ranks #1 among open-weight models on its Vals Index (#8 overall). Evaluator teortaxesTex reviewed his own pre-release predictions: he underestimated K3.1's Artificial Analysis score and overestimated its Vals score by roughly equal margins, while having been nearly perfectly calibrated on the previous 1017 model — leading him to conclude Vals is currently the more trustworthy benchmark index.
Related event: Kimi K3.1 Tops Vals Open-Source Ranking, Sparking Benchmark Debate(2 posts)→
More from Models
- Rumor: open-weight Claude Sonnet 5.5-xhigh could land within 10 days — AaronBergman18 · 2026-10-25
- GPT-6.1-Terra spotted in Microsoft eval configs ahead of rumored OpenAI Codex finale release — kimmonismus · 2026-10-25
- Reddit questions DavidAU's Turbo-Brilliance HF collection: 50x reasoning claims, zero benchmarks — Miserable-School-665 · 2026-10-25
- Screenshot shows steered model flipped to endorsing violence, safety circles alarmed — eigenron · 2026-10-25
- Mystery 'Iron Goddess' video model appears on LM Arena, believed from a major Chinese lab — koltregaskes · 2026-10-25
- Bill Gates wants powerful open-weight models legally confined to government-certified platforms — rohanpaul_ai · 2026-10-25