Artificial Analysis launches Decision Index for the emerging decision model category
ArtificialAnlys · x · 2026-10-16
Artificial Analysis says it will keep developing the Decision Index to help developers and companies understand the emerging class of decision models. The composite index combines four benchmarks, each weighted 25%: AA-Omniscience-Decision (private dataset for knowledge and hallucination, accuracy + non-hallucination at 12.5% each), HLE-MultiChoice (text-only multiple-choice from Humanity's Last Exam, reasoning), When2Call (NVIDIA's tool-calling eval), and WildGuardTest (safety classification, F1). All evaluations are run independently by Artificial Analysis. Decision models pick from a fixed set of options with per-option probabilities in one call — cheap, fast, and calibration-measurable.
More from Models
- Swapping RLM sub-calls for Jev: half the cost, 6x faster at 1M tokens — lateinteraction · 2026-10-16
- Stanford users say OpenAI cut ChatGPT Edu Pro usage 50% mid-contract — DJiafei · 2026-10-16
- MiniCPM-V 4.5 MoE reportedly hits 13+ tokens/s on iPhone with just 3GB memory — heyshrutimishra · 2026-10-16
- IQuest-Q1 writes a 629-line submarine game from one prompt in 2 minutes — Div_pradeep · 2026-10-16
- Trying Grok bot surfaces an unpaid Cursor balance, blocking account merging — haydendevs · 2026-10-16
- TensorFold 1.0.12 runs 120B vision model on 1-2 DGX Sparks, adds Mac image input — HankYeomans · 2026-10-16