GPT-6 Astra Tops GDP.pdf Long-Document Reasoning Benchmark at 33.2% All-Pass Rate
ArtificialAnlys · x · 2026-09-05
Artificial Analysis shared per-model GDP.pdf results: OpenAI's GPT-6 Astra leads at 33.2%, with GPT-5.6 Sol at 28.2% and Claude Fable 5.1 at 26.2%. Created by @HelloSurgeAI, GDP.pdf tests single-turn professional document reasoning across 100 PDFs and ten domains, requiring models to synthesize evidence from 4,592 pages of text, tables, charts, and footnotes, graded against 1,275 expert-authored atomic criteria with an all-pass headline metric.
More from Models
- Ask your AI agent its favorite color — it apparently has one — every · 2026-10-21
- Google demos Gemini 4 Argon building a 3D periodic table synced to Tom Lehrer's 'The Elements' — sundarpichai · 2026-10-21
- MiniMax follow-up: M3.1 Flash teased after GTC release wave — MaziyarPanahi · 2026-10-21
- Claude Max 5x limits feel generous: heavy user can't burn through weekly quota — Angaisb_ · 2026-10-21
- General Intuition announces API coming soon, pitching itself as the frontier lab for acting in space and time — chris_j_paxton · 2026-10-21
- Stronger Model, Weaker Product: Dev Defaults to Fable 6.1 Sol Ultra Over 5.1 — curious_vii · 2026-10-21