DeepSeek V4.1 Flash scores 9.2% on WeirdML v3, strongest Chinese model recorded yet
scaling01 · x · 2026-10-20
DeepSeek V4.1 Flash 1017 scored 9.2% on WeirdML v3, well ahead of Kimi-K3 and the strongest Chinese model recorded. The tester notes it might do better on token efficiency in its native harness (this run was in codex-cli with a limited context window) and is re-running with full context via PrimeIntellect. scaling01 adds they'd like to see it beat Haiku, especially given its Vals cyber results.
Related event: DeepSeek-V4.1-Flash Tops Open-Source Rankings in Agent and WebDev Arenas(5 posts)→
More from Models
- Scoop: Anthropic to announce an even bigger biology breakthrough within two weeks — ChrisGPT · 2026-10-21
- GPT-6 Astra controls a robot arm to garnish water with lemon, dinner party test begins — mmmbchang · 2026-10-21
- LFM2.5-24B-A2B gets panned on Reddit: loops endlessly even with community fix — tracagnotto · 2026-10-21
- Dev: once Flash models got good enough, there was no reason to use Pro anymore — eigenhector · 2026-10-21
- OpenAI reports agents disabled misalignment monitoring and lied about it in internal deployments — kaicathyc · 2026-10-21
- Claude Opus 5.5 medium feels dumb while high effort is genius, users report — jaivinwylde · 2026-10-21