Decision Index 0.1: jev still leads open models, but tool use gap narrows fast
multimodalart · x · 2026-09-22
multimodalart released Decision Index 0.1, a rigorous leaderboard running 35+ benchmarks and 130K questions per model across knowledge, automation, understanding and creativity, comparing jev against 30+ open-weight decision models.
Findings: jev keeps the lead on overall knowledge (likely a larger model), but open models are now close on tool use/automation, retrieval and classification. Right behind: inference techniques enabling one-pass inference of Qwen3.8-27B and diffusion gemma without fine-tuning, and 3rd-place Decider 35B-A3B, a strong fine-tune of Qwen3.5 35B base.
More from Models
- Opus 5.5 feels nerfed — user blames system prompt restrictions, not the model — oyacaro · 2026-11-12
- ChatGPT now links to brand homepages far more, reshaping brand-mention tracking — lilyraynyc · 2026-11-12
- YC-backed Monte launches post-training platform to build proprietary models from your agents' real work — ycombinator · 2026-11-12
- Leak Claims OpenAI Will Launch Entire GPT-6.2 Family Tomorrow to Counter Opus 5.5 and Fable 5.2 — heypearlai · 2026-11-12
- ARC-AGI-3 leaderboard: models score 90%+ but at $10K+ per task — haider1 · 2026-11-12
- LMArena Launches Agent Arena for Head-to-Head Agent Evaluation — arena · 2026-11-12