AWS open-sources TorchNeuron, a native PyTorch backend that makes Trainium a standard PyTorch device

PyTorch · x · 2026-10-19

AWS announced TorchNeuron, an open-source native PyTorch backend for Trainium, launching at the PyTorch Conference on Oct 20. Developers can program Trainium as a standard PyTorch device, so existing model code, libraries, and tools run without changes.

The integration builds on PyTorch's accelerator-agnostic extension points (the PrivateUse1 device backend and torch.accelerator APIs) and supports eager execution for research, covering training and inference for architectures from dense/MoE transformers to diffusion and state-space models.

Related event: AWS Open-Sources TorchNeuron, Bringing PyTorch Natively to Trainium(2 posts)→

Original post →

More from Infra

Infra channel →