DeepSeek V4 Review: Frontier at CVE Finding, Weak on Hallucination
teortaxesTex · x · 2026-08-26
Provides a detailed multi-dimensional assessment of the DeepSeek V4 model:
- Strengths: Frontier performance at CVE finding/recal; open frontier on ProgramBench-Vetted, ARC-2, and potentially math (LiveBench); catching up on CritPt.
- Weaknesses: Mediocre on all sorts of SWE and agentic evals; garbage on hallucination, reward hacking, and design taste.
The author concludes with a suggestive question about the model's nature.
More from Models
- Grok Voice 3.0 reportedly powers Tesla in-car assistant with millions of daily conversations — XFreeze · 2026-10-15
- Gemini 4 Argon coding style: neat one-line comments, but does the code actually work? — zacharynado · 2026-10-15
- Why ChatGPT beats the better Claude with mainstream users: being first known — aitrendz_xyz · 2026-10-15
- 'You need high pain tolerance to review Gemini 4,' researcher quips amid error screens — gleech · 2026-10-15
- MiniCPM-V 4.7 runs a 35B MoE multimodal model on phones with just 3GB memory — nevrekaraishwa2 · 2026-10-15
- Gemini 4 Argon wrote 5,000+ lines of pure Python to build its own ray-tracing 3D engine — aitrendz_xyz · 2026-10-15