DeepSeek evals v4.1 flash in 8 harness configs — best in minimal harnesses, worse in Claude Code and Codex
zainhas · x · 2026-09-10
DeepSeek benchmarked its new v4.1 flash model across 8 different agent harness configurations. The model performs best in minimal harnesses (mini-SWE and the minimal deepseek harness) but underperforms in both Claude Code and Codex — a sign its fit with heavier harnesses still needs work.
Related event: DeepSeek Tests v4.1 flash Across 8 Harnesses, Minimal Setups Win(3 posts)→
More from coding & agent
- shadcn's /improve skill paired with Grok on SuperGrok Heavy for plowing through issues — shadcn · 2026-10-27
- Paradigm Launches Envoys: Your Claude Code and Codex on Your Research Graph, Free — tensorqt · 2026-10-27
- LangChain to demo the internal design agent its team uses daily, this Wednesday — LangChain · 2026-10-27
- AXL launches remote MCP server exposing 1,284 sales and marketing APIs to Claude and Codex — EdTech_Padre · 2026-10-27
- GitHub's Thomas Dohmke ships Entire, a Git forge built for agent-human collaboration — carrycooldude · 2026-10-27
- OmarchyTV hits GitHub: Omarchy-style TV launcher with AI TUI and MCP — alexcovo_eth · 2026-10-27