PyTorch 2.14 ships with 2,995 commits: nccl2 backend, Inductor and Metal upgrades

PyTorch · x · 2026-09-12

PyTorch 2.14 is out with 2,995 commits from 487 contributors since 2.13. Key updates: NVGEMM and CuTeDSL-generated CUTLASS kernels in Inductor, a new nccl2 backend for PyTorch Distributed, fault-tolerant collectives and process-group reconfiguration in c10d, native linear algebra and Metal kernel improvements on Apple Silicon, plus torch.switch and CUDA graph capture for torch.whil. A community Q&A is scheduled for September 17, 2026.

Original post →

More from Infra

Infra channel →