Google open-sources TorchTPU: native PyTorch on TPUs, 52% of peak training Qwen 3 8B

rohanpaul_ai · x · 2026-10-21

At PyTorch Conference 2026, Google open-sourced TorchTPU, a native PyTorch stack for TPUs co-developed with Meta. It supports standard PyTorch APIs, eager-mode debugging via torch.compile, and tools like vLLM, SGLang, Ray, and Hugging Face; it reached up to 52% of peak TPU compute training Qwen 3 8B, replacing the PyTorch/XLA compiler path and reducing Nvidia lock-in.

Related event: Google and Meta Open-Source TorchTPU, Bringing Native PyTorch Support to TPU(6 posts)→

Original post →

More from Infra

Infra channel →