DeepSeek-V4-Flash Eval: Underperforms Kimi K3 in Both Cost and Score
kms_dev · reddit · 2026-08-01
A developer tested DeepSeek-V4-Flash-0731 across 34 prompts. The results show that the model's providers on OpenRouter were unstable, requiring multiple generation retries.
In terms of cost and performance, DeepSeek-V4-Flash cost $1.29 and scored 2.7/5 with 5 failed outputs. In contrast, Kimi K3 cost only $0.44, scored 3.2/5, and had zero failures.
More from Models
- DeepSeek Becomes Top Provider on OpenRouter as US Model Share Plummets — damianplayer · 2026-08-01
- Developer complains Opus 5 writes incomprehensible READMEs, needs babysitting — Al_Grigor · 2026-08-01
- Physicist Sabine Hossenfelder: LLMs Still Fail at Writing Video Scripts — skdh · 2026-08-01
- Inkling 12B Active Params Outperforms 41B Version in Medical Diagnosis — MaziyarPanahi · 2026-08-01
- Local Quantized Inkling 276B Model Accurately Diagnoses Heart Failure from Audio — MaziyarPanahi · 2026-08-01
- Beyond Cost: Privacy and Fine-tuning as the True Tipping Points for Open-Weight Models — cyb3rops · 2026-08-01