DeepSeek-V4 Pro benchmark: Top performance at ultra-low cost
zainhas · x · 2026-08-15
An analysis by Together AI reveals that DeepSeek-V4 Pro 0813 achieves an 88.5% pass@4 score on DeepSWE software engineering tasks, outperforming GPT-5.6 Sol and Fable 5. It costs only $0.24 per task, making it 35x cheaper than Sol and 90x cheaper than Fable.
Related event: DeepSeek-V4 Pro Beats Rivals in Cost-Effective Benchmark(10 posts)→
More from Models
- Google's Gemini 4 Argon performs noticeably worse in AI Mode than in AI Studio — gaganghotra_ · 2026-10-16
- Devs say LLM coding mistakes are a different class: overcomplication, inferred limits, worse at higher reasoning — Mu5_ · 2026-10-16
- ChatGPT UI screenshot reveals Wallet coming soon plus Email, Calendar, Health and Finances integrations — jxnlco · 2026-10-16
- Why the next OpenAI and Anthropic models may still disappoint: no native audio or video input — imjustnewatai · 2026-10-16
- Thousands Hit by ChatGPT Standard Voice Mode Regression: Wrong Voice, Interruptions — shaunralston · 2026-10-16
- Gemini Argon 4 Quota Exhausted, Reset Countdown Shows Nearly 7 Days — ssh4net · 2026-10-16