PyTorch’s Helion DSL now targets TPU kernel authoring through Pallas

PyTorch · x · 2026-07-24

PyTorch says Helion, its DSL for custom kernels, is expanding toward hardware-heterogeneous kernel authoring.

• Meta and Google show how Helion compiles to TPU via Pallas.
• The idea is to give developers a unified way to write performant TPU kernels inside the PyTorch ecosystem.
• The blog uses FlashAttention as a case study.
• The compiler autotunes across multiple code-generation strategies, choosing pipelining schemes based on input shapes to maximize compute–memory overlap.

Original post →

More from Infra

• Gemini CLI patch blocks credential leakage by forcing HTTPS for auth provider — amelidev · 2026-07-24
• AMD’s Ryzen AI Halo targets local AI apps with 128GB unified memory — ryanshrout · 2026-07-24
• A user wants an API layer that can start and stop local models on demand — minaminotenmangu · 2026-07-24
• Baseten and CapitalG set a demo night on owning the inference stack on August 4 — baseten · 2026-07-24
• AMD claims MI350P delivers 2–5x tokens per dollar in enterprise workloads — ryanshrout · 2026-07-24
• Databricks Genie runs as an MCP server inside LangGraph, then ships to Azure ML — Cautious-Meringue554 · 2026-07-24

Infra channel →