Meta launches Muse Spark Open: 816B MoE coding model with 42B active params and 1M token context
PyTorch · x · 2026-11-18
Muse Spark Open Key Facts
Meta has launched Muse Spark Open, an 816B-parameter MoE model optimized for agentic coding, activating 42B parameters per token via top-8 routing across 256 experts, with a 1M token context window that can hold an entire project including complex dependencies and thousands of files.
- Trained on NVIDIA GB300 NVL72 Blackwell Ultra; claims higher first-attempt accuracy, reliable tool calling, and deep cross-repository codebase understanding.
- Adds audio and video perception on top of image/document understanding, processing interleaved modalities natively via a 1.8B perception encoder.
- Ships NVFP4 checkpoints optimized for Blackwell Ultra FP4 Tensor Cores, shrinking the memory footprint of all 816B parameters.
Deployment & Fine-tuning
- On GB300 NVL72, agentic workloads deliver up to 50K tokens/sec per GPU and 600 tokens/sec per user.
- NVFP4 weights are downloadable from Hugging Face; a downloadable NVIDIA NIM offers single-command production setup.
- NVIDIA NeMo AutoModel, a PyTorch-native training library with native Hugging Face checkpoint support and no model conversion, enables out-of-the-box full SFT and LoRA fine-tuning for rapid domain-specific experimentation.
Related event: Meta releases Muse Spark Open, an 816B-parameter MoE coding model(2 posts)→
More from coding & agent
- Vercel ships eve 1.0: open-source framework for production agents on your own harness — cramforce · 2026-11-18
- Sharing a "RAM" with my agent: a stack-based memory keeps revisions on goal — alfcnz · 2026-11-18
- Preview launches cloud GPU-accelerated Blender driven entirely by its agent — farooqib · 2026-11-18
- x402 opens four public working groups: domain discovery, identity, tax, card acceptance — kleffew94 · 2026-11-18
- Stanford CS329Z releases two standout lectures on agent design patterns and multi-agent systems — stanfordnlp · 2026-11-18
- How one developer built a robot companion in 24 hours with Astra — gabrielchua · 2026-11-18