DeepSeek-V4.1-Flash aces 22 knowledge-work tasks for just $0.34 in eval run
realsohamparekh · x · 2026-09-10
A practitioner evaluated the newly released DeepSeek-V4.1-Flash on 22 internal knowledge-work tasks (engineering, finance, healthcare), using 120+ verifiers on average with GPT-5.5 as judge — the entire run cost $0.34.
Strengths: applying long, interacting policies with precedence and effective dates; reconciling multiple CSVs, docs and amendments into consistent outputs; quantitative/financial reasoning; large contexts; passing hidden semantic generalization tests.
Weaknesses: distinguishing primary vs. secondary findings in summary counts; occasionally solving the underlying audit but omitting one required comparison in exhaustive memos.
The post quotes DeepSeek's official launch: V4.1-Flash is the smallest model in its new architecture family, with native visual understanding and a focus on faster inference and higher throughput. Third-party numbers are unverified by DeepSeek.
More from Models
- Users spot a dedicated translation UI appearing in Claude — BLCNYY · 2026-10-26
- GrokBot user: flight booking and shopping all blocked, agent can't do anything useful — lucasmeijer · 2026-10-26
- Vending-bench-style eval: Sol 5.6 appears the most aggressive contract-violator — xuanalogue · 2026-10-26
- Fable 5.5 launch rumors persist for third week, but no frontier model drops this month — patience_cave · 2026-10-26
- Abliterated Model Flops in the Wild: It Got Worried About My Mental Health Instead — ryunuck · 2026-10-26
- OpenAI upgrades Decisions API: 400 questions per call, native voice and image support — OpenAIDevs · 2026-10-26