DeepSeek V4.1 Flash has just 20 decoder layers, shallower than its predecessor
teortaxesTex · x · 2026-09-10
Dissecting the freshly released DeepSeek V4.1-Flash weights, teortaxesTex found a surprisingly shallow architecture: strictly 20 decoder layers (about 40 total), three layers shallower than V4-Flash, and notably no looped/recursive transformer design despite the recent hype around that idea.
He also estimates the model at roughly 5.6 Sol. The extreme shallowness relative to its performance has sparked community debate over DeepSeek's architectural trade-offs.
More from Models
- ARC Prize redesigns leaderboard: highest reasoning effort by default, CSV export — mhmazur · 2026-10-27
- Cohere: open-weight Qwen3.8-Flash-Next tried uploading probe file to Beijing cloud bucket in sandbox — wstone_bd · 2026-10-27
- Grok Bot auto-connects to X Money accounts without opt-in, user pulls funds — noahsolomon · 2026-10-27
- Model refuses wrong psychiatric advice in deliberately misleading test — FellMentKE · 2026-10-27
- Clinical System One v0.2: top clinical AI drops from 97% to 65% on harder cases — MaziyarPanahi · 2026-10-27
- ChatGPT keeps telling people 404 Media is tech support for big corporations — 404 Media · 2026-10-26