Perplexity's pplx-decider-v1.2 tops ValsAI's new ClaimBench benchmark
bo_wangbo · x · 2026-10-21
ValsAI released ClaimBench, a new benchmark for decision models that tests whether a model can tell if a financial document supports, contradicts, or doesn't address a claim. They evaluated 15 models on 1,960 claims paired with 10-K excerpts, with Perplexity's pplx-decider-v1.2 leading the pack of decision models. It's available on OpenRouter and Perplexity's API Console.
Related event: Perplexity's Decider V1.2 Tops Vals AI's New ClaimBench(3 posts)→
More from Models
- claudefriend screenshot reveals its policy model is a Qwen trained to please Claude — Sauers_ · 2026-10-21
- Microsoft quietly ships Sentiment-Analysis-7B, an RL-tuned Mistral-7B on Hugging Face — NielsRogge · 2026-10-21
- Ask your AI agent its favorite color — it apparently has one — every · 2026-10-21
- Google demos Gemini 4 Argon building a 3D periodic table synced to Tom Lehrer's 'The Elements' — sundarpichai · 2026-10-21
- MiniMax follow-up: M3.1 Flash teased after GTC release wave — MaziyarPanahi · 2026-10-21
- Claude Max 5x limits feel generous: heavy user can't burn through weekly quota — Angaisb_ · 2026-10-21