jev Decision Index v0.3 arrives with private benchmark half and vision rankings
multimodalart · x · 2026-10-07
multimodalart released jev Decision Index v0.3, an independent ranking of model decision-making: a much stronger benchmark set with a private half so scores track skills beyond public leaderboards, plus new vision rankings covering multimodal models.
Related event: SWE Decision Index v0.3 Adds Private Benchmarks and Vision Rankings(2 posts)→
More from Models
- Models rapidly improve at predicting experiment outcomes, may close 90% of gap by 2030 — SaxenaNayan · 2026-10-07
- Reflection Beam and Mistral Large 4 hit GLM-5.2 level, sparking distillation gap debate — Yuchenj_UW · 2026-10-07
- Mistral's new 1T-param/49B-active model beats rivals on legal benchmarks — BLUECOW009 · 2026-10-07
- Mistral CEO: Large 4 trained on our own compute, 'RL shows no sign of saturation' — sivareddyg · 2026-10-07
- Decider model gains from unmasking and more data, authors deny benchmaxxing — antoine_chaffin · 2026-10-07
- Tesla's Grok voice goes hoarse but can't hear itself — a look at AI engineering shortcuts — PTrubey · 2026-10-07