Artificial Analysis launches Decision Index v2: Mammoth 27B near GPT-6 Luna at 118x speed
ArtificialAnlys · x · 2026-11-09
Artificial Analysis released Decision Index v2, benchmarking decision models across document decisions/extraction, tool calling, knowledge/hallucination, reasoning and invariance via six weighted evals (AA-Paperclip 30%, EvalSafe-ONET-AA 15%, When2Call 10%, AA-Omniscience-Decision 15%, HLE-MultiChoice 15%, AA-Symmetry 15%). On speed, Celeris-1.1 Decision leads at 56 ms per task vs Claude Haiku 5.5 (Max) at 32.65 s; Mammoth 27B scores within 4 points of GPT-6 Luna (Max) while being 118x faster.
Related event: Artificial Analysis Launches Decision Index v2(2 posts)→
More from Models
- Reddit asks: why run open-weight models in production instead of APIs? — allenling · 2026-11-09
- Google reportedly building full Gemini 4 model suite, codenamed Krypton — ThePrimeNumbers · 2026-11-09
- Reddit users puzzled: why is everyone still on Qwen3 instead of the newer 3.5 models — opUserZero · 2026-11-09
- AMD CEO Lisa Su: Meta Muse hit 10M activations in 45 days as AI adoption accelerates — rohanpaul_ai · 2026-11-09
- Running Ripple 65B Preview NVFP4 on SGLang with 2x RTX PRO 6000: full recipe — HankYeomans · 2026-11-09
- DSpine boosts Qwen3.8-27B to 94-132 tok/s in llama.cpp, 1.75x over DFlash2 — pbaylies · 2026-11-09