Vera Rubin NVL72 Delivers 5x Inference Performance Per Watt Over GB200
downingARK · x · 2026-07-30
SemiAnalysis released an in-depth inference TCO and architecture analysis comparing NVIDIA's next-gen Vera Rubin NVL72 with the current GB200 NVL72.
- Performance Leap: Early engineering samples show Vera Rubin delivering 5.4x performance per MW and 5x performance per dollar over GB200 NVL72 when running DeepSeek R1. As Rubin is still in early bring-up, this gap is expected to widen.
- Smoother Software Transition: NVIDIA has released the first Rubin (SM107) software stack with CUDA 13.4 and upstreamed PRs to PyTorch, vLLM, and OpenAI Triton. Unlike the Hopper-to-Blackwell transition, Rubin can reuse Blackwell's WGMMA kernels, significantly accelerating time-to-market.
- Architecture Details: The analysis details Rubin's new 3-bit programmable LUT tensor core. Additionally, GitHub info reveals the next-gen Feynman architecture is SM140, and the Rubin-to-Feynman kernel transition will be substantially more complex.
More from Infra
- Meta's commitments jumped to $349B in a quarter as server memory prices tripled ahead of Oct 21 earnings — tengyanAI · 2026-10-16
- Meta releases Muse Spark Open, trained with vLLM-powered RL inference from day one — colinmcnamara · 2026-10-16
- Meta's open Muse Spark needs 493GB of memory — far beyond any consumer laptop — TejasKumar_ · 2026-10-16
- CoreWeave plunges 20% as credit markets price >60% default odds; is this dot-com all over again? — kimmonismus · 2026-10-16
- MiniCPM-V 4.7 35B-A3B hits 17+ tokens/s on iPad with ~3GB memory — techNmak · 2026-10-16
- China rolls out 'token factories' and a 2026-28 token economy action plan — nordicinst · 2026-10-16