Lambda Labs Breaks Record with All-Reduce on 10,368 GB300 GPUs

TheZachMueller · x · 2026-08-22

Lambda Labs announced a new record for the largest cluster-wide All-Reduce on its platform, running across 10,368 NVIDIA GB300 GPUs. The test utilized 9 pods and 144 racks, marking a 2.5x increase over their previous record.

Related event: Lambda Runs All-Reduce Test Across Over 10,000 GB300 GPUs(2 posts)→

Original post →

More from Infra

Infra channel →