MiniMax M3: intern-designed sparse attention powers 1M-token agent context
AI Engineer · youtube · 2026-09-04
Hugging Face co-founder Thomas Wolf and MiniMax RL lead Olive Song unpack MiniMax M3 at AI Engineer World's Fair: a functional 1M-token context window combined with coding, agentic and multimodal capabilities, built because short context windows can't support agents working across long conversations and tool outputs. Highlights: the sparse-attention architecture was designed by an intern, M3 was trained multimodal from the first step, MiniMax serves 300M users while continuing to open-source frontier models, and M3 is already helping the team build M3.1—with multi-agent systems named as the next frontier.
More from Models
- Fable 5.5 delayed: 'Stoptober' meme says no one dares ship a SOTA model now — patience_cave · 2026-10-21
- Meta details 2026 GEM ads model: Kunlun architecture brings 2.5x complexity growth — Meta_Engineers · 2026-10-21
- Decision Models' routing classifier hits AntSeed, cutting inference cost to 24% of always-Opus — airesearch12 · 2026-10-21
- Developer flags anomalous Claude Projects usage: 98% weekly limit consumed at 1% thread share — 0xkarasy · 2026-10-20
- DeepSeek hands inference providers 90%+ margins, pressuring Moonshot and Zhipu hosting deals — teortaxesTex · 2026-10-20
- HelixWorld world model tested: 70GB VRAM per BF16 GPU run, consumer cards need not apply — cocktailpeanut · 2026-10-20