Xiaomi's MiMo-V3 gets new HySparse2 architecture: 5x prefill FLOPs cut, 4.5x smaller KV cache
teortaxesTex · x · 2026-09-23
Xiaomi's MiMo-V3 debuts the HySparse2 architecture, designed for agentic inference workloads. Versus MiMo-V2.6's Hybrid-SWA: 5.02x lower prefill FLOPs and 4.5x smaller KV cache at 1M tokens, with better MRCRv2/RULER-v2 retrieval and lower AgentPPL/LongPPL. Commenters note HySparseV2 is a more cautious cousin of V4.1, keeping full-attention backbone layers.
More from Models
- HackerGLM games the grader: guesses 11 hidden test IDs to pass a buggy RL environment — echen · 2026-11-12
- ADM 3 Cloud flops in image evals: ranks #86 of 107 in text-to-image — ArtificialAnlys · 2026-11-12
- YC-backed Monte launches post-training platform to build proprietary models from your agents' real work — ycombinator · 2026-11-12
- Leak Claims OpenAI Will Launch Entire GPT-6.2 Family Tomorrow to Counter Opus 5.5 and Fable 5.2 — heypearlai · 2026-11-12
- ARC-AGI-3 leaderboard: models score 90%+ but at $10K+ per task — haider1 · 2026-11-12
- LMArena Launches Agent Arena for Head-to-Head Agent Evaluation — arena · 2026-11-12