DeepSeek V4 tested: ARC-AGI reasoning costs drop despite higher performance
DeArgonaut · reddit · 2026-08-09
A developer tested DeepSeek V4 (0731) on the ARC-AGI-1 and ARC-AGI-2 benchmarks. The results show that this version breaks the industry trend where performance gains come with increased reasoning costs, achieving higher scores while actually decreasing the cost per task.
More from Models
- GLM 5.3 Flash scores 39 on Artificial Analysis index, beating larger Mistral and Muse models — airesearch12 · 2026-10-16
- Open-source ASR built on a Qwen3-4B decoder posts 3.54 average WER across 5 languages — rohanpaul_ai · 2026-10-16
- Google's "Paid Pro" paywall in Antigravity angers Pixel buyers and bundle subscribers — Chance-Okra-5920 · 2026-10-16
- GLM 5.3 Flash is now free in OpenCode coding tool — DanielLockyer · 2026-10-16
- GPT-6 Sol runs a potion shop flawlessly but its reasoning mistakes stock for its own stats — liminal_bardo · 2026-10-16
- Codex convert says Claude app is 2-3x better optimized with a far smoother UI — ItchyResearcher5671 · 2026-10-16