Gemini Decision 1 debuts: tops decision benchmarks but costs 3x rivals

Google has released its first decision model, Gemini Decision 1, and Artificial Analysis published a full evaluation on November 12: a Decision Index v2.1 score of 66, short of frontier level, on par with models like Elephant 9B and Jev 1.1.

Confirmed

Overall score 66; it tops the knowledge-reasoning subcategory (AA-Omniscience-Decision), ahead of d1-ultra (64) and the GLiD series, though @ArtificialAnlys notes its edge comes from calibration rather than raw accuracy
The evaluation table shared by @Angaisb shows: Jevbench 92.2%, Amazon ESCI 58.7%, New Yorker Caption 79.7%, PubMedQA 79.8% — leading on multiple benchmarks with a calibration error of just 0.025
Latency: averaging 211ms per 21 tasks, faster than Drex Max v1.1 (283ms) and GLiDE v1.2 (284ms) but slower than small models, mid-tier overall
Cost: $345 per 1 million tasks, close to GPT-6 Luna (Decisions, $339) and more than 3x that of leaderboard leader Drex Max

Why it matters

This marks Google's first entry into the decision-model arena. @ArtificialAnlys's evaluation shows it is competitive in reasoning quality and calibration, but its value for money clearly lags — it would need major cost reductions to challenge the top of the leaderboard.

2026-11-12 ~ 2026-11-12 · 6 related posts

Full story(2 episodes)→

Episode 1: Google Launches Gemini Decisions API with Decision 1 Model(2026-11-12, 22 posts)
Episode 2: Gemini Decision 1 debuts: tops decision benchmarks but costs 3x rivals(2026-11-12, 6 posts)

Primary sources

Google's Gemini Decision 1 scores 66 on AA Decision Index, trails leaders at 3x the cost — ArtificialAnlys · 2026-11-12 02:18 (UTC+08:00)
Gemini Decision 1 clocks 211ms per task, mid-pack on Artificial Analysis Decision Index — ArtificialAnlys · 2026-11-12 02:18 (UTC+08:00)
Gemini Decision 1 Benchmarks Leak: Leads Most Evals With 0.025 ECE — Angaisb_ · 2026-11-12 02:29 (UTC+08:00)

[source] Google's Gemini Decision 1 scores 66 on AA Decision Index, trails leaders at 3x the cost — ArtificialAnlys · 2026-11-12
Gemini Decision 1 costs $345 per 1M tasks, 3x pricier than leader Drex Max v1.1 — ArtificialAnlys · 2026-11-12
Gemini Decision 1 tops knowledge and reasoning evals on calibration, at a steep cost — ArtificialAnlys · 2026-11-12
Gemini Decision 1 answers in 211ms per task, mid-pack on latency, top on knowledge — ArtificialAnlys · 2026-11-12
[source] Gemini Decision 1 clocks 211ms per task, mid-pack on Artificial Analysis Decision Index — ArtificialAnlys · 2026-11-12
[source] Gemini Decision 1 Benchmarks Leak: Leads Most Evals With 0.025 ECE — Angaisb_ · 2026-11-12