Meta's Muse Spark Open: 816B MoE coding model with 1M context, tuned on NVIDIA GB300 NVL72

sergeykarayev · x · 2026-11-18

Meta launched Muse Spark Open, an MoE model built for agentic coding: 816B total parameters, 42B active per token via top-8 routing across 256 experts, trained on NVIDIA GB300 NVL72 Blackwell Ultra.

Key specs:

Engineering path: post-train on domain data with NVIDIA NeMo AutoModel (PyTorch-native, Hugging Face checkpoints, no conversion) supporting full SFT and LoRA, or deploy via a one-command NVIDIA NIM. Weights are on Hugging Face.

Notable as a pattern: frontier model releases now ship with a full fine-tuning and inference stack attached.

Original post →

More from coding & agent

coding & agent channel →