Google Cloud and Inferact partner to make TPU a first-class vLLM target
vllm_project · x · 2026-09-15
- Google Cloud and Inferact (the company behind vLLM) announced an engineering partnership to make TPU a first-class citizen in vLLM, with all work open-sourced.
- Scope: production serving features and optimized kernels, a native PyTorch path via TorchTPU, and day-0 support for frontier model releases.
- A community program offers shared TPU capacity for open-source contributors plus dedicated review/design help from Inferact's core vLLM maintainers.
- Context: vLLM supports 5,000+ model architectures with 3,000+ contributors; Anthropic has committed to scale to as many as 1 million TPUs, and the latest Ironwood generation is built for inference.
More from Infra
- Your AI agent would cost 260% more without prompt caching, Arena data shows — arena · 2026-10-30
- Nebius runs auction-driven GPU pricing, lifting rates ~20% amid tight supply to 2028 — BenBajarin · 2026-10-30
- macOS update silently re-adds eMudhra root certs users had removed — steipete · 2026-10-30
- Bittensor's Terza Inference routes one API across miners' models on subnet 103 — const_reborn · 2026-10-30
- SGLang Summit 2026 sells out sponsor booths and Full Passes ahead of Nov 12–13 event — ying11231 · 2026-10-30
- OpenRouter rebuilds provider routing: 46% fewer capacity errors, 16.9% faster TTFT — steipete · 2026-10-30