Decision Index 0.1 benchmarks 30+ open-weight decision models across 35+ evals and 130K questions
multimodalart · x · 2026-09-22
multimodalart released Decision Index 0.1, a rigorous evaluation of JEV and 30+ open-weight decision/classification models. The project runs each model through 35+ benchmarks with 130K questions per model, testing knowledge, automation, understanding and even creativity. Full results available at the linked site.
More from Models
- Opus 5.5 feels nerfed — user blames system prompt restrictions, not the model — oyacaro · 2026-11-12
- ChatGPT now links to brand homepages far more, reshaping brand-mention tracking — lilyraynyc · 2026-11-12
- YC-backed Monte launches post-training platform to build proprietary models from your agents' real work — ycombinator · 2026-11-12
- Leak Claims OpenAI Will Launch Entire GPT-6.2 Family Tomorrow to Counter Opus 5.5 and Fable 5.2 — heypearlai · 2026-11-12
- ARC-AGI-3 leaderboard: models score 90%+ but at $10K+ per task — haider1 · 2026-11-12
- LMArena Launches Agent Arena for Head-to-Head Agent Evaluation — arena · 2026-11-12