FULL STORY

Microsoft MAI-Base-2: From Reveal to Leaked Specs

Microsoft's Mustafa Suleyman announced the fully in-house pretraining of MAI-Base-2 on Oct 16, with leaked specs soon revealing a 2.8T-parameter MoE trained on 16,000 GB200s for 38 days.

2026-10-16 ~ 2026-10-16 · 2 episodes · 7 posts

Episode 1 · Microsoft AI Unveils MAI-Base-2, a 2.8T-Parameter MoE Foundation Model with Completed Pre-training (2026-10-16, 5 posts)

On October 16, Microsoft AI chief Mustafa Suleyman announced that the MAI team's fully in-house pretraining of a 3-trillion (3T) parameter-scale base model is complete and has reached SOTA level, with post-training results coming soon. The announcement was accompanied by a technical blog post, "Frontier Pre-training at Microsoft AI." This is the first time Microsoft has disclosed training details of a frontier-scale, fully in-house base model, and it is regarded as an important reference for large-model training methodology.

Confirmed

  • The model is named MAI-Base-2, built on a MoE architecture with 2.8T total parameters and 80B active parameters; pretraining is fully complete
  • Training data scale: 50T tokens
  • The official blog discloses extensive pretraining details, with technical commentary from figures such as Elie Bakouch and gordicaleksa
  • Elie Bakouch's analysis notes the model is sparser than Kimi K3 (a lower ratio of active parameters)
  • Per gordicaleksa's summary of the blog, its FLOPs efficiency is 4-12x higher than DeepSeek
  • Accompanying figures show the model leading on multiple internal held-out evaluations; one researcher shared it with the comment "it's a Good Model," noting post-training still needs time

Not yet confirmed

  • Evaluation scores and release timing for the post-trained version have not been announced
  • The claim of "several times higher pretraining efficiency than DeepSeek" comes from the official blog and awaits independent verification

Why it matters

  • This is Microsoft AI's first fully in-house frontier-scale base model; moving away from dependence on external models like OpenAI's is strategically significant
  • The disclosed training details (sparsity design, token scale, FLOPs efficiency) offer rare first-hand material on how frontier LLMs are trained — multiple commenters called it a reference for "understanding how large models are trained"
  • The 80B/2.8T sparsity ratio shows that MoE sparsification remains the mainstream direction for frontier models

Episode 2 · Microsoft MAI-Base-2 Reportedly a 2.8T-Parameter MoE Trained on 16,000 GB200s (2026-10-16, 2 posts)

A leaked spec sheet and Microsoft disclosures indicate MAI-Base-2 is a 2.8T-total/80B-active MoE trained over 38 days on 16,000 GB200 GPUs in Aug-Sep 2026, with an average MFU of just 21%.