Perplexity ships Decider V1.2, tops Vals AI's new ClaimBench decision-model benchmark
bo_wangbo · x · 2026-10-21
Perplexity released pplx-decider-v1.2, the top-scoring model on ClaimBench, a new decision-model benchmark from Vals AI that tests whether a model can tell if a financial document supports, contradicts, or doesn't address a claim — 15 models evaluated on 1,960 claims paired with 10-K excerpts.
Decider V1.2 is a 27B checkpoint that doesn't generate text: it reads state (text, JSON, or images) and returns typed, probabilistic answers in one request — yes/no probabilities, choice distributions over up to 255 options, or rubric-level probabilities with an expected score. Built for classification, routing, moderation, and rubric grading where app code thresholds the numbers.
Priced at $0.02/M input tokens (output free) with 262K context; a cheaper Decider Flash V1.2 shares the same API contract. Available via OpenRouter and Perplexity's API console.
More from Models
- Dev complains Anthropic's bio safeguards trigger just from reading a bio paper — robleclerc · 2026-10-21
- Redditor claims uncensored local DeepSeek build answers virus-writing prompt with zero hesitation — Only_Light_9817 · 2026-10-21
- Interconnects Artifacts 25: 28 new models, DeepSeek V4.1 Flash, and US-China regulatory controls — natolambert · 2026-10-21
- Ternary-Bonsai-2-9B: 2-bit ternary vision-language model trends on Hugging Face for on-device use — prism-ml · 2026-10-21
- Grok Bot DAU hits new peak as users report it books flights and pays bills — elonmusk · 2026-10-21
- Agnes AI ships agnes-3.0-qwen: 180B MoE with 1M context, strong agentic scores — jacek2023 · 2026-10-21