Microsoft completes MAI-Base-2, a 2.8T-parameter MoE trained on 16k GB200 GPUs
VectorWireAI · reddit · 2026-10-16
Report says Microsoft finished pretraining MAI-Base-2, a 2.8T-parameter MoE model trained on 16,000 NVIDIA GB200 GPUs.
Related event: Reported Microsoft MAI-Base-2: 2.8T-Parameter MoE Trained on 16,000 GB200s(3 posts)→
More from Models
- Reflection's 501B MoE Beam hits 463 tok/s on 8x GB200 with NVFP4 at day 0 — zhyncs42 · 2026-10-16
- LMArena launches Agent Arena and Code Arena leaderboards for model comparison — arena · 2026-10-16
- Third-party tests find NVIDIA Nemotron-3.5 Bolt underperforms nano on pandas/numpy and decision-making tasks — norenEnmotalen · 2026-10-16
- Reflection open-sources Beam under Apache 2.0 with 40+ partner ecosystem — bhutanisanyam1 · 2026-10-16
- One Prompt, 629 Lines: IQuest-Q1 Builds a Deep-Sea Submarine Game in 2 Minutes — Div_pradeep · 2026-10-16
- Swapping RLM sub-calls for Jev: half the cost, 6x faster at 1M tokens — lateinteraction · 2026-10-16