PyTorch Conference to showcase DeepSpeed's tensor, sequence, and expert parallelism beyond ZeRO
PyTorch · x · 2026-10-07
PyTorch announced that Masahiro Tanaka will present "DeepSpeed Is Not Just ZeRO" at PyTorch Conference North America 2026, covering AutoTP, AutoSP, and AutoEP (tensor, sequence, and expert parallelism) and how they combine with ZeRO, with benchmarks.
Registration details: late-bird attendee tickets are $999, academic tickets stay at $249, and teams of 10+ get a 25% discount.
More from Infra
- Free Online Conference All Day AI Set for Oct 22 With Talks on SLMs and Local Inference — FikoFox · 2026-10-07
- Paris' Tour Montparnasse Plans 120,000 Nvidia B300s Delivering 540 EFLOPS at 304MW — IgorCarron · 2026-10-07
- PyTorch Replaces CUDA with FBTriton for Embedding Kernels: 1.28x Faster Forward, 2x Backward — PyTorch · 2026-10-07
- Nvidia B200 Prices Are Skyrocketing Amid Intense AI Compute Scramble — matt_slotnick · 2026-10-07
- Google & MIT's Coco: an agent platform for TPU hardware-model co-design — dair_ai · 2026-10-07
- Dev builds Rust desktop API gateway unifying OpenAI/Anthropic APIs on one GPU — rootshelldev · 2026-10-07