DeepSeek V4.1 Flash hits up to 93.3x per-chip throughput on Vera Rubin NVL72 vs GB300

Xianbao_QIAN · x · 2026-11-17

The vLLM project published the first DeepSeek V4.1 Flash results on NVIDIA's Vera Rubin NVL72, powered by Dynamo + vLLM and measured on SemiAnalysis's AgentX benchmark.

Using InferenceX's performance ruler, compared with GB300 NVL72 running the same Dynamo + vLLM stack:

These are among the first public LLM inference comparisons on the new Rubin platform, highlighting how the vLLM + Dynamo combo scales on next-gen hardware.

Related event: vLLM shares first DeepSeek V4.1 Flash results on NVIDIA Vera Rubin NVL72(5 posts)→

Original post →

More from Infra

Infra channel →