Microsoft MAI-Base-2 Reportedly a 2.8T-Parameter MoE Trained on 16,000 GB200s
A leaked spec sheet and Microsoft disclosures indicate MAI-Base-2 is a 2.8T-total/80B-active MoE trained over 38 days on 16,000 GB200 GPUs in Aug-Sep 2026, with an average MFU of just 21%.
2026-10-16 ~ 2026-10-16 · 2 related posts
- Episode 1: Microsoft AI Unveils MAI-Base-2, a 2.8T-Parameter MoE Foundation Model with Completed Pre-training(2026-10-16, 5 posts)
- Episode 2: Microsoft MAI-Base-2 Reportedly a 2.8T-Parameter MoE Trained on 16,000 GB200s(2026-10-16, 2 posts)
- Microsoft's MAI-Base-2: 2.8T-param MoE pretrained on 16k GB200s in just 38 days — scaling01 · 2026-10-16
- Microsoft trained MAI-Base-2 on 16k GB200 GPUs in just 38 days, with 21% MFU — scaling01 · 2026-10-16