vLLM ships Day-0 support for Muse Spark Open: 816B MoE, 1M context, multimodal

vLLM Blog · rss · 2026-10-15

vLLM announced Day-0 support for Muse Spark Open. Key specs and features:

• 816B MoE architecture
• 1M context window
• Multimodal inputs
• DSpark speculative decoding
• Serving on both NVIDIA and AMD, plus initial TPU support
• LoRA RL support

For self-hosters, vLLM covers multiple hardware paths on day one.

Original post →

More from Infra

• Cadence announces sovereign AI cloud for European chip designers — karlfreund · 2026-10-23
• SGLang Deep-Dive Blog Series Breaks Down KV Cache, Posts up to 15.5x Throughput Gains — BanghuaZ · 2026-10-23
• DynaLM: Open-Source CPU-First LLM Inference Engine Seeks Feedback — Unlikely_Safety_7456 · 2026-10-23
• Capital Is Now the AI Buildout Bottleneck, Says Analyst Citing Jensen Huang — JOBhakdi · 2026-10-23
• DynaLM: an open-source CPU-first LLM inference engine seeks testers and feedback — Unlikely_Safety_7456 · 2026-10-23
• Cerebras explains how it deploys trillion-parameter models on wafer-scale chips — bookwormengr · 2026-10-23

Infra channel →