Perplexity Decider tops DecisionBench with 93.9% accuracy, 534ms latency, and lowest cost
AravSrinivas · x · 2026-10-09
Perplexity's Decider V1.1 ranks #1 on DecisionBench, an open benchmark of bounded decisions built from real records, while also being the cheapest option.
On 949 shared text cases it scored 93.9% accuracy with 534ms median latency at $0.016 per 1k decisions. Perplexity CEO Arav Srinivas shared the result; the benchmark team says they'll adopt it in their own product.
More from Models
- LightOnOCR-3 released: 0.8B/1B/4B open models for OCR, layout, charts under Apache 2.0 — antoine_chaffin · 2026-10-09
- Claude 3 Opus confirmed working within Max plan monthly API credits — repligate · 2026-10-09
- Leak: Grok Voice Mode coming to X — talk to Grok out loud in the app — nima_owji · 2026-10-09
- Subscription Claude models deliver far fewer thinking tokens, measured five ways — _AustinCalvert_ · 2026-10-09
- GPT-6 in ChatGPT is the best AI writer yet — barely needs editing, says user — VraserX · 2026-10-09
- Reddit User Finds GPT-6 Appears to Lack Direct Access to Saved Memories — ItsAGarbageAccount · 2026-10-09