DeepSeek V4-Pro Ranks #2 Open-Weight Model, Accused of Relying on pass@2
teortaxesTex · x · 2026-08-13
DeepSeek's V4 Pro 0813 jumped 11 points on the Vals Index, becoming the #2 open-weight model at just $0.14 per task—17x cheaper than Kimi K3, the only open-weight model above it.
However, a technical observer expressed disappointment and skepticism regarding its performance:
- Mechanism Critique: Noted that V4-Pro is essentially V4-Flash-0731 combined with pass@2 (generating multiple samples and picking the best).
- Distillation Hypothesis: Suspected that DeepSeek's internal distillation strategy equalizes model scales, making the smaller Flash model appear more impressive.
Related event: DeepSeek V4 Pro Released and Potentially Withdrawn Due to Wrong Version(18 posts)→
More from Models
- GLM 5.5 rumored to drop soon, coding ability expected to match frontier models — bindureddy · 2026-10-16
- Five rounds of adversarial prompting make Opus 5.5 and Argon converge on identical output — LanceCharger · 2026-10-16
- DIY benchmark ranks 18 models on subjective judgments, GLM-5.3 tops consensus match — arkuto · 2026-10-16
- Bindu Reddy: Google's Argon excels at complex doc writing at half the cost of Opus — bindureddy · 2026-10-16
- MAI-2 is 2x bigger than V4-Pro while V4.1F is 3x smaller: Microsoft's scaling ladder questioned — teortaxesTex · 2026-10-16
- Step 5 Preview hits DeepInfra day-zero: 600B MoE, 1M context, $1/M input tokens — StepFun_ai · 2026-10-16