ETH's Hoefler at SC26: Networks Matter More Than GPUs for AI Supercomputers

thoefler · x · 2026-11-17

Torsten Hoefler (ETH Zurich + Microsoft) previews three SC26 sessions on AI supercomputers, arguing networks matter even more than accelerators. His slides ("Beyond the GPU") cover: a CACM-accepted paper with Dongarra & Matsuoka showing matrix engines + HBM give CPUs GPU-like numerical capability (matched GPU performance at 1.3x energy efficiency and 2.2x cost-efficiency on A64FX, though hardware utilization was <10%); and the SDLA abstraction — program data movement, not just math — pipeline MOVE/COMPUTE/COMMUNICATE via control programs, keep hot data local and overlap the rest. GPUs remain ahead for frontier-scale training, for now.

Original post →

More from Infra

Infra channel →