vLLM promotes TPU to first-class backend with new unified support
vllm_project · x · 2026-08-27
vLLM announced that TPUs are now a first-class backend, powered by the new tpu-inference hardware plugin. This update unifies JAX and PyTorch under a single lowering path, allowing developers to run PyTorch models performantly on TPUs without code changes while maintaining vLLM's standard interface. Recommended TPU generations include v7x, v5e, and v6e, with comprehensive documentation and recipes now available.
More from Infra
- Next-gen GraalVM benchmarks: 4x faster startup, 2x less memory, no build step needed — RealGeneKim · 2026-10-15
- How Microsoft optimized Windows for Nvidia's Arm-based RTX Spark AI laptops — tomwarren · 2026-10-15
- How Microsoft optimized Windows for Nvidia's Arm-based RTX Spark laptops — The Verge AI · 2026-10-15
- Global smartphone shipments plunge 22% in worst quarterly decline on record as AI demand fuels memory costs — Polymarket · 2026-10-15
- SK Hynix drops 11% again, now below 3x FY2027 earnings as AI memory selloff deepens — JOBhakdi · 2026-10-15
- ASML Sells Zero Lithography Machines into Europe as US Hosts 75%+ of AI Compute — NinaDSchick · 2026-10-15