First DeepSeek V4.1 Flash results on Vera Rubin NVL72: up to 93.3x per-chip throughput vs GB300

vllm_project · x · 2026-11-17

The vLLM project published the first DeepSeek V4.1 Flash inference results on NVIDIA Vera Rubin NVL72, powered by Dynamo + vLLM on SemiAnalysis's AgentX benchmark.

Compared with GB300 NVL72 running the same Dynamo + vLLM stack, InferenceX's perf ruler shows per-chip total token throughput of:

The chart shows the gap widening sharply with interactivity requirements: GB300 throughput collapses past 400 tok/s/user while Vera Rubin sustains usable throughput beyond 1800 tok/s/user.

Original post →

More from Infra

Infra channel →