DeepSeek accused of benchmark gaming: new Flash model underwhelms in real use
Arindam_1729 · x · 2026-09-27
@bindureddy called DeepSeek "the king of acing benchmarks," arguing its new Flash model claims parity with Fable and Astra but falls apart after two minutes of actual use. Replying, Arindam noted the model's vision capabilities do hold up well in his testing.
Related event: Developers Slam DeepSeek's New Model as Benchmark Champ, Real-World Flop(2 posts)→
More from Models
- Running DeepSeek 4.1 locally on an $800 rig with a used RTX 3090 at 2-3 tok/s — LankyGuitar6528 · 2026-11-11
- Google open-sources Harness², an agent that rewrites its own setup per task — Arindam_1729 · 2026-11-11
- Dev dumps Codex desktop app over quality issues, falls back to codex-cli — tekbog · 2026-11-11
- Why do old models get dumber before launches? Lab party, says joking X post — glcst · 2026-11-11
- Grok Bot now detects hidden prompt injections, warns users and refuses to follow them — XFreeze · 2026-11-11
- Shanghai Institute Open-Sources Nex-N2.6, a 321B Multimodal Agentic Model — victormustar · 2026-11-11