vLLM serves DeepSeek V4.1-Flash at 954K tokens/s per GPU, $38.96/GPU-hour on GB300 NVL72

bookwormengr · x · 2026-11-16

vLLM and SGLang teams independently confirmed bookwormengr's math: at DeepSeek V4.1-Flash off-peak prices, Grace-Blackwell and Vera Rubin chips can yield $38 and $102 revenue per GPU-hour respectively. Per vLLM's blog, one GB300 NVL72 rack with P/D disaggregation and Wide-EP serves SemiAnalysis AgentX at 954K tokens/s per GPU (P90 196 tokens/s per user), a 7.9x jump over their single-node result, worth $38.96/GPU-hour. Decode throughput is within 6% of DeepSeek's own DeepInfer engine, proving a general-purpose engine can match a model-specific one. A Rubin peak operating point reaches 2.52M tokens/s/GPU ($102.91/GPU-h), 2.64x GB300 throughput.

Original post →

More from Infra

Infra channel →