It's 100,000 GPUs, not NVL72 racks: viral cluster-size claim corrected
firstadopter · x · 2026-09-07
firstadopter corrects a viral claim about massive training clusters: the real figure is 100,000 GPUs, not 100,000 NVL72 servers (which would imply 7.2 million Blackwell GPUs). He notes million-GPU/TPU training clusters remain in the future, and the widely shared estimate was off by roughly an order of magnitude.
Related event: Correction: Rumored Giant Cluster Is 100K GPUs, Not 100K NVL72 Racks(2 posts)→
More from Infra
- Encrypted GPT-2 speedrun challenges FHE inference: best is 3.031 s/token, goal sub-1s — tensorqt · 2026-10-27
- Open-source Latch compiles PyTorch into training megakernels, 2.75x faster on H100 — sguada · 2026-10-27
- Stanford launches GPU-centric supercomputer Marlowe for data science and AI research — StanfordHAI · 2026-10-27
- NVIDIA Claims HGX Rubin NVL8 Delivers 10x More Tokens per Megawatt Than B200 — thursdai_pod · 2026-10-27
- Together lets multiple LoRA post-training experiments share the same GPU capacity — togethercompute · 2026-10-27
- Commoditization dilemma: either human labor or GPUs become the commodity — _AustinCalvert_ · 2026-10-27