Full-Parameter RL on TPUs: peano_ai Runs 310B MiMo-V2.6 Across 1,000+ TPUs
simonguozirui · x · 2026-09-22
peanoai announced full-parameter reinforcement learning on TPUs, including MiMo-V2.6 at 310B and other stable training runs of 1,000+ steps across 1,000+ TPUs.
Key details: built on JAX so scaling up is a config change rather than a rewrite; optimized vLLM inference for faster rollouts; full bitwise trainer–sampler agreement in validation; trainer and sampler share one TPU ICI fabric, transferring all 310B parameters in under 2 seconds.
The result demonstrates a viable engineering path for very large-scale RL training on the TPU stack.
More from Infra
- Gas-for-AI-datacenters forum co-located with CoRL shows energy demand spillover — carlosdponx · 2026-11-12
- a16z podcast: Mike Volpi on Cisco's 70+ acquisition playbook and the AI buildout — a16z · 2026-11-12
- AMD to pass Intel in server revenue by mid-2027 as share gains 6 points a year — BenBajarin · 2026-11-12
- Study: Reflective Data Center Roofs Actually Cool Daytime Ground by 1.8-2.2°C — SumitGup · 2026-11-12
- Tsinghua's BaGuaLu-2 tames MoE expert-load spikes at runtime, accepted to SC26 — jiqizhixin · 2026-11-12
- antirez backs low-bit DeepSeek 4.1 Flash over Qwen 27B dense on Apple M5 Macs — antirez · 2026-11-12