Muse Spark Open: Meta's 816B multimodal MoE built for agentic coding hits Hugging Face
mervenoyann · x · 2026-10-16
Hugging Face welcomes Meta's Muse Spark Open with day-0 support in transformers and llama.cpp.
Key points:
- MoE with 816B total parameters, 42B active per token; 256 experts per layer, 8 selected per token
- One model ingests text, images, audio, and video, outputs text, with up to 1M-token context
- Larger-scale MoE following Muse Glimmer; the most capable US open-weight model to date
Meta targets agentic coding: trained on real developer workflows like multi-file refactors and long debugging sessions, it plans, acts, observes, and self-corrects over long tasks including web browsing with images — reading screenshots, listening to voice notes, or watching screen recordings while coding.
The article also covers how to run and fine-tune it, plus build examples.
Related event: Meta Open-Sources Muse Spark Open with 816B Parameters and 1M Context(39 posts)→
More from coding & agent
- Photon 2.0 lets AI agents reach users via WhatsApp, Telegram, SMS and voice in one click — techNmak · 2026-10-16
- Figma launches Guidelines and Code Sources so AI agents can follow your design system — JaynitMakwana · 2026-10-16
- Ex-DeepMind Eng Lead's AI Calling Agent Fo Cut Hang-Up Rate from 80% to 20-30% — julianweisser · 2026-10-16
- SPACE Open-Sources Its Sandbox Platform for Agentic Code Execution — marktenenholtz · 2026-10-16
- Cognition Launches Devin OnCall to Auto-Investigate Production Alerts — DevinAI · 2026-10-16
- Running a multi-model UI design arena: Paseo orchestrates four design drafts per model — vista8 · 2026-10-16