Cloud B200 Test: RoCE Throughput Falls Far Short of InfiniBand

Tests on two Lambda HGX B200 nodes without InfiniBand show RoCE Ethernet delivers only about a quarter of InfiniBand throughput, matching Lambda's official comparison data and highlighting interconnect's impact on inference performance.

2026-11-20 ~ 2026-11-21 · 2 related posts

1 near-duplicate retellings: TheZachMueller