DeepSeek V4 architecture reportedly redesigned: more stable and efficient, not simpler

teortaxesTex · x · 2026-10-21

DeepSeek watcher Teortaxes comments on reports that V4 uses a redesigned architecture said to be stable, scale more predictably, and be vastly more efficient — though not clearly simpler. Attached screenshots show community debate over choices like sqrt(softplus(·)), HashMoE, and compute budgets, with some calling V3.2's DSA the most elegant public LLM architecture. Unverified speculation ahead of V4.1 Pro.

Original post →

More from Models

Models channel →