PyTorch 2.13 Released
PyTorch · x · 2026-07-18
PyTorch 2.13 has been released, bringing updates spanning attention, compilation, distributed training, memory efficiency, Python compatibility, and accelerator platform support.
This release comprises 3,328 commits from 526 contributors. A live Q&A session is scheduled for July 22, where maintainers and contributors will discuss the release and answer community questions.
Key changes include:
- FlexAttention
- Inductor's CuTeDSL Native DSL backend
- nn.LinearCrossEntropyLoss
- torchcomms
- FSDP2 communication overlap improvements
- Linux Python 3.15 wheel, including free-threaded 3.15t builds
- Expanded support for ROCm, Arm, and Intel XPU
More from Infra
- Super Proxy open-sources a self-hosted multi-provider LLM gateway with fallback and cost caps — Delicious-Flan88 · 2026-07-21
- Marker will get more accuracy improvements, while Chandra remains the high-accuracy option — VikParuchuri · 2026-07-21
- Nebius says SlimSpec speeds speculative decoding 8–9% without shrinking the vocabulary — Arindam_1729 · 2026-07-21
- NVIDIA brings its Cosmos 3 Edge world model to Jetson for on-device robot control — liu_mingyu · 2026-07-21
- A silicon photonic reservoir chip compensates fiber distortion in real time at 28 Gbps — bravo_abad · 2026-07-21
- Chamath says open-sourcing Grok would push AI margins from models to infra and apps — Dan_Jeffries1 · 2026-07-21