New Decision Index benchmark runs 132,422 decisions; Jev still tops at 59.5
victormustar · x · 2026-09-22
Jev is only a week old and already has 31 open reproductions, but most comparisons so far ran only a few hundred decisions. A new benchmark, Decision Index 0.1, runs 132,422 decisions — every reproduction plus Jev across 37 benchmarks — with no truncation, no prompt tuning, and unanswered counts as wrong. Jev still tops it at 59.5.
More from Models
- Opus 5.5 feels nerfed — user blames system prompt restrictions, not the model — oyacaro · 2026-11-12
- ChatGPT now links to brand homepages far more, reshaping brand-mention tracking — lilyraynyc · 2026-11-12
- YC-backed Monte launches post-training platform to build proprietary models from your agents' real work — ycombinator · 2026-11-12
- Leak Claims OpenAI Will Launch Entire GPT-6.2 Family Tomorrow to Counter Opus 5.5 and Fable 5.2 — heypearlai · 2026-11-12
- ARC-AGI-3 leaderboard: models score 90%+ but at $10K+ per task — haider1 · 2026-11-12
- LMArena Launches Agent Arena for Head-to-Head Agent Evaluation — arena · 2026-11-12