Artificial Analysis launches Decision Index benchmark combining four evals
kalyan_kpl · x · 2026-10-15
Artificial Analysis introduced the Artificial Decision Index, measuring decision models across classification, tool calling, knowledge, hallucination, and reasoning. It combines four equally weighted evals — AA-Omniscience-Decision (private knowledge/hallucination set), HLE-MultiChoice (reasoning), NVIDIA's When2Call (tool calling), and WildGuardTest (safety classification) — all run independently. Top model scores 58, with the field tightly packed between 48 and 58.
Related event: Artificial Analysis Launches Decision Index for Decision Models(2 posts)→
More from Models
- Third model weighs in: Astra's measured take on automated art vs Fable and Argon — keenanisalive · 2026-10-15
- One prompt, three models: Fable vs Argon disagree on whether artists want automated art — keenanisalive · 2026-10-15
- StepFun open-sources Step 5 Preview: 600B-param MoE, 27B active, 1M context — teortaxesTex · 2026-10-15
- Astra's answer on automating art: the creative process is where the meaning lives — keenanisalive · 2026-10-15
- 9 AI Models Summarize Edited Huckleberry Finn; Only Claude Followed Both Times — GaryMarcus · 2026-10-15
- Alexandr Wang hails new Muse model's writing and orchestration, naming and pricing panned — alexandr_wang · 2026-10-15