Kimi K3.1 Pro gets day-0 vLLM support on Google's TPU v7x in joint collaboration
woosuk_k · x · 2026-11-06
The vLLM team partnered with Google to bring day-0 support for Kimi K3.1 Pro to vLLM on TPU v7x. It's the first zero-day TPU inference support for Moonshot AI's flagship model, and signals Google actively courting third-party frontier models onto its TPU ecosystem.
Related event: Kimi K3.1 Pro Gets Day-0 Inference Support on Google TPU(2 posts)→
More from Infra
- sshhole Bug Analysis: Alpine/MUSL Systems Hit Hard, ~100-500M OpenWRT Routers Were at Risk — esrtweet · 2026-11-06
- Smarter Compact: MCP server trims agent context, 72% cheaper long sessions with full recall — goost95 · 2026-11-06
- TensorFold 1.2.3 boosts Flash Next decode 21–23%; Apache-2.0 Ripple-65B Preview lands — AIFlow_ML · 2026-11-06
- "What am I supposed to do if the data center bubble pops" — AI infra circle jokes — max_paperclips · 2026-11-06
- Inkling 2 Small pretrained on 8.4T tokens in 68 hours, natively in NVFP4 — clarejtbirch · 2026-11-06
- Stable reinforce handles 8-minute rollouts with FP4 weights in open RL training — simonguozirui · 2026-11-06