DeepSeek-V3 Beats GPT-4o and Claude 3.5 Sonnet on DeepSWE Benchmark
zainhas · x · 2026-08-15
According to a user evaluation, DeepSeek-V3 (Pro 0813) achieves a higher pass@4 score on the DeepSWE benchmark compared to GPT-4o and Claude 3.5 Sonnet (referred to as Fable 5 in the post). The model is noted for having moments of brilliance.
Related event: DeepSeek-V4 Pro Beats Rivals in Cost-Effective Benchmark(10 posts)→
More from Models
- OpenAI Voice Update Adds French, German, Hindi, Korean, Japanese Voices and Naturaler Preambles — shaunralston · 2026-10-16
- Why aren't labs training on hundreds of millions of videos for native audio/video? — imjustnewatai · 2026-10-16
- ChatGPT UI screenshot reveals Wallet coming soon plus Email, Calendar, Health and Finances integrations — jxnlco · 2026-10-16
- Why the next OpenAI and Anthropic models may still disappoint: no native audio or video input — imjustnewatai · 2026-10-16
- Thousands Hit by ChatGPT Standard Voice Mode Regression: Wrong Voice, Interruptions — shaunralston · 2026-10-16
- Gemini Argon 4 Quota Exhausted, Reset Countdown Shows Nearly 7 Days — ssh4net · 2026-10-16