Muse Glimmer 30B Hits 3,323 tok/s on a Single NVIDIA GH200

MaziyarPanahi · x · 2026-08-12

Developer MaziyarPanahi shared an extreme inference test: running the Muse Glimmer 30B model at 3,323 tok/s on a single NVIDIA GH200. The setup utilized vLLM 0.26, BF16 precision, and FlashAttention 3, with support for a 131K context window.

He also opened a temporary, free public API endpoint, inviting users to send difficult prompts to stress-test the model and find its breaking point.

Related event: Single GH200 GPU Achieves 3323 tok/s in Inference Test(2 posts)→

Original post →

More from Infra

Infra channel →