NVIDIA says Blackwell Ultra hit 1,648 TFLOPs per GPU on DeepSeek-V3 671B training
NVIDIAAI · x · 2026-07-21
NVIDIA says Blackwell Ultra set a new throughput record on DeepSeek-V3 671B pre-training, reaching 1,648 TFLOPs per GPU.
- NVIDIA says this is about 3× the delivered throughput of the previous generation.
- The company attributes the gain to co-design and software optimization across Megatron-Core, TorchTitan, and JAX.
- The chart compares GB200 NVL72 with GB300 NVL72, showing the jump from 606 to 1,648 TFLOPs/GPU.
Related event: NVIDIA Blackwell Ultra Sets DeepSeek-V3 Training Throughput Record(2 posts)→
More from Infra
- SkyPilot exits stealth with compute orchestration for fragmented AI fleets — skypilot_org · 2026-07-22
- Production AI budgets include retries, routing, caching and observability—not just token prices — arx-go · 2026-07-22
- NVIDIA briefs analysts on Vera CPU and doubles down on monolithic agentic design — BenBajarin · 2026-07-22
- NVIDIA unveils Vera Rubin platform with claims of 10x better performance per watt — nvidia · 2026-07-22
- SkyPilot comes out of stealth with a pitch to unify fragmented AI compute — skypilot_org · 2026-07-22
- Why a 1GW Chinese AI data center may be plausible after all — teortaxesTex · 2026-07-22