Xiaomi's MiMo sparsity upgrade seen as mirroring DeepSeek's NSA-to-DSA move
teortaxesTex · x · 2026-09-24
Observers note Xiaomi's MiMo models are skipping a generation: V2.6 still uses the 2025-style MiMo Hybrid-SWA design, while HySparse—like NSA and MoBA—is a published research idea turned into engineering. The key change in HySparse2 is moving from block sparsity to token-level sparsity, seen as exactly DeepSeek's move from NSA to DSA (token top-k) in V3.2-Exp. HySparseV2 reads as a more cautious cousin of a future V4.1, keeping YOCO and full-attention backbone layers while gaining prefill and memory efficiency. Third-party analysis, not official.
More from Models
- Grok Bot now auto-detects and blocks prompt injection hidden in web pages — heypearlai · 2026-11-12
- ChatGPT now links to brand homepages far more, reshaping brand-mention tracking — lilyraynyc · 2026-11-12
- YC-backed Monte launches post-training platform to build proprietary models from your agents' real work — ycombinator · 2026-11-12
- Leak Claims OpenAI Will Launch Entire GPT-6.2 Family Tomorrow to Counter Opus 5.5 and Fable 5.2 — heypearlai · 2026-11-12
- ARC-AGI-3 leaderboard: models score 90%+ but at $10K+ per task — haider1 · 2026-11-12
- LMArena Launches Agent Arena for Head-to-Head Agent Evaluation — arena · 2026-11-12