Xiaomi MiMo runs full-parameter RL on 310B model across 1000+ TPUs with JAX
AccBalanced · x · 2026-09-22
The Xiaomi MiMo team details scaling RL with JAX + TPU: full-parameter RL on the 310B MiMo-V2.6 and 1000+ stable training steps across 1000+ TPUs. Highlights: scaling up is mostly a config change rather than a rewrite; optimized vLLM inference speeds up rollouts; bitwise trainer–sampler agreement in validation; trainer and sampler share one TPU ICI fabric, transferring all 310B parameters in under 2 seconds. Built with Berkeley AI and Google Cloud, more details promised.
More from Infra
- Leaked memo: Meta infrastructure head Santosh Janardhan to leave in early 2027 — dinabass · 2026-11-12
- Omarchy 4.6 lets you share local AI models across your tailnet, says DHH — alexcovo_eth · 2026-11-12
- Eric Schmidt's foundation funds French NGO fighting against data centers — StephanSturges · 2026-11-12
- Epoch: Open-Weight GLM 5.3 Hacks Six Firefox Versions for ~$1,000 Each; Claude Fable 5.2 Sets ECI Record — Epoch AI · 2026-11-12
- Polymarket prices 28% odds of a state data center moratorium; Torus raises $500M — Polymarket · 2026-11-12
- AWS-wrapper cloud startup shuts down just one month after seed round — thedealdirector · 2026-11-12