DeepSeek-V4 Pro beats Sol and Fable in coding tasks
zainhas · x · 2026-08-15
In a head-to-head benchmark on software engineering (DeepSWE) tasks, DeepSeek-V4 Pro achieved an 88.5% pass@4 accuracy, outperforming both Fable 5 and GPT 5.6 Sol. It also offers massive cost savings at $0.24 per task, making it 35x and 90x cheaper than Sol and Fable respectively.
Related event: DeepSeek-V4 Pro Beats Rivals in Cost-Effective Benchmark(10 posts)→
More from Models
- Dev: Claude writes 'zero bugs' on healthcare apps, 10x token efficiency — repligate · 2026-10-16
- Shanghai AI Lab unveils Intern Lumina U2, a diffusion LLM unifying image, video and 3D tasks — Shanghai-AI-Laboratory · 2026-10-16
- This Week in Tech breaks down Gemini 4, OpenAI's Dots agents, and Anthropic's leaked IPO filing — LouMM · 2026-10-16
- Sentry CEO Reveals $8,972 Claude Bill as Opus 'Scope Creeps' Through Team Workloads — zeeg · 2026-10-16
- Opus 5.5 wins: Anthropic reclaims token and spend share from OpenAI in 6 days — FinanceYF5 · 2026-10-16
- will.deeb: asking why a minor lab benchmarked against a 2-month-old frontier model is usually a stupid question — willcb · 2026-10-16