Decision Index 0.4 drops public benchmarks entirely, re-ranks 224 models on private evals
Thom_Wolf · x · 2026-10-22
- multimodalart updated the Decision Index to 0.4: to curb benchmaxxing, the score is now built exclusively from private and in-house benchmarks, with stronger private benchmarks on new domains.
- 224 models evaluated, with new top models in all size classes.
Related event: Decision Index 0.4 switches to private benchmarks to fight benchmark gaming(2 posts)→
More from Models
- Rumors: Next Chinese AI Models Coming in Under 7 Days, Hacks 'Just the Prelude' — kimmonismus · 2026-10-22
- How much is an Anthropic Team subscription actually worth in tokens? Reddit tries to do the math — Acrobatic_Pool_713 · 2026-10-22
- Tencent open-sources Hunyuan-MT2: a 440MB offline translation model running on phones in 33 languages — alexcovo_eth · 2026-10-22
- Open tool computes API vs. RunPod self-hosting breakeven across 450+ models, with VRAM sizing — zackku · 2026-10-22
- DeepMind AI Agent Autonomously Discovers and Lean-Verifies Rules for 11 Unsolved Turing Machines — rohanpaul_ai · 2026-10-22
- Ling-3.1-flash-1019 scores 44 on AA Intelligence Index, big agentic gains, open weights soon — teortaxesTex · 2026-10-22