Microsoft to Scale Azure Maia to Multi-Gigawatt Deployments; Maia 300 Claims 40% More Tokens per Megawatt
Recoil42 · reddit · 2026-10-12
Microsoft announced a new phase for its custom silicon: starting 2027, the Azure Maia family scales to multi-gigawatt deployments, making Maia the primary inference system for Microsoft products and services.
Maia 200 already serves production workloads including Microsoft Copilot and supports MAI team model development; GitHub Copilot and Microsoft Foundry follow by year-end. Maia 200 runs OpenAI models, Microsoft's own MAI models, and leading open-source families.
Maia 300 targets long-context reasoning, latency-sensitive conversations, and multi-step agentic workloads, claiming 40% more tokens per megawatt than leading GPU-based systems and up to 7x Maia 200's rack-scale token throughput in a 96-accelerator configuration.
Related event: Microsoft Unveils Maia 300, Betting Big on In-House AI Silicon(10 posts)→
More from Infra
- OpenAI chip head Richard Ho on Jalapeno: why Broadcom beat Nvidia and AMD as partner — richardjnieva · 2026-10-12
- Bittensor's TPN Labs ships first model TPN005, cutting base size ~40% with 32k context intact — const_reborn · 2026-10-12
- Microsoft to scale in-house Maia AI chips to multi-gigawatt inference by 2027 — The Decoder · 2026-10-12
- Microsoft plans huge deployment of its own AI chips to cut costs — pstAsiatech · 2026-10-12
- Ragged KV cuts Looped LM inference FLOPs by 25% with no retraining — DanielKhashabi · 2026-10-12
- NVIDIA's ELR removes the one-loop tax: Koi-4B scores 18 at one loop, 29 at four loops — nvidia · 2026-10-12