GDPx, GDPval's Long-Horizon Successor: Best Model Scores Just 11.1%
japie06 · reddit · 2026-11-02
A new frontier-level long-horizon benchmark, GDPx — successor to GDPval — tests long-horizon feature work, debugging, and migrations in large production codebases, and even the best models score only 12%.
The software-engineering leaderboard shows Gemini 4 Carbon leading at 11.1% ($8.16/task, 282K output tokens); Claude Opus 5.5, GPT 6.1 Sol, and Gemini 4 Argon tied at 8.9% (per-task costs ranging from $2.57 to $16.97); GPT-6 Astra at 6.7%, Claude Fable 5.1 at 4.4%, Muse Wonder Full at 2.2%; while DeepSeek 4.1 Flash, GPT-6 Luna, Grok 4.7, Kimi K3, Qwen 3.8 Max, and GLM 5.3 all scored 0%. Tasks are graded per each domain's method and averaged over 3 attempts.
More from Models
- User reports xAI appears to have quietly raised weekly usage limits, dropping his meter from 93% to 47% — XFreeze · 2026-11-02
- Meituan's LongCat-2.5 lands as 1.6T MoE agent model, with DeepSeek copycat speculation — teortaxesTex · 2026-11-02
- Asked what AI firms want you to stop owning, Claude said: your own compute — alex_verem · 2026-11-02
- Is Hermes Still Worth It? Codex's $200 Tier Now Overlaps Most of Its Value — Foreign_Lead_3582 · 2026-11-02
- Compacting earlier cuts agent costs 16-23%; GLM 5.3 costs 30x less than Grok 4.7 — yb2698 · 2026-11-02
- Codex capacity errors spike whenever OpenAI hands out banked resets — CtrlAltDwayne · 2026-11-02