Xiaomi's MiMo-V3 to Adopt New HySparse2 Architecture

Xiaomi's MiMo-V3 will adopt the new HySparse2 architecture (paper 2609.26368 on arXiv), cutting prefill compute by 5x and KV cache by 4.5x for agentic workloads. Observers note the jump echoes DeepSeek's NSA-to-DSA path, as V2.6 still uses the older Hybrid-SWA design.

2026-09-23 ~ 2026-09-24 · 3 related posts

• MiMo-V3 to get new architecture, core HySparse2 paper published on arXiv — Recoil42 · 2026-09-23
• Xiaomi's MiMo-V3 gets new HySparse2 architecture: 5x prefill FLOPs cut, 4.5x smaller KV cache — teortaxesTex · 2026-09-23
• Xiaomi's MiMo sparsity upgrade seen as mirroring DeepSeek's NSA-to-DSA move — teortaxesTex · 2026-09-24