SGLang Announces Day-0 Support for Meta's Muse Glimmer, Hitting 230 tok/s on RTX 5090
NVIDIAAI · x · 2026-08-10
SGLang has announced Day-0 support for Meta's newly released Muse Glimmer multimodal model.
With NVFP4 and DFlash optimizations enabled, the model achieves inference speeds of approximately 230 tokens/second on a single RTX 5090 GPU. It also runs out of the box on NVIDIA RTX PRO 6000, DGX Spark, and Apple Silicon via the MLX framework.
Related event: Meta Open-Sources 30B Muse Glimmer for On-Device Agents(108 posts)→
More from Infra
- Optuna creator Akiba: when 2 hyperparameters cost $20M, what's left for BO/HPO — Stefania_druga · 2026-10-16
- Amazon Proposes Per-Request Validated Evidence Caching for Production RAG — _reachsumit · 2026-10-16
- LinkedIn's TransX report: sequence transduction for recsys, +6.02% CTR in A/B tests — _reachsumit · 2026-10-16
- llama.cpp PR boosts CPU inference speed with merged AVX2 tiled accumulators — jacek2023 · 2026-10-16
- Zero's next-gen IVM engine runs in a single DO, live-querying a 100GiB R2 database — threepointone · 2026-10-16
- Meme: driving to the chip factory in 2028 captures AI's compute anxiety — beffjezos · 2026-10-16