Meta runs AI inference on Google TPUs in production
Google released TPU-native vLLM and SGLang inference engines, with Meta confirming production use of TPUs; the new SGLang-TorchTPU plugin reaches 770 tok/s single-stream decoding in Meta's production.
2026-10-21 ~ 2026-10-22 · 2 related posts
- Episode 1: Google and Meta Open-Source TorchTPU, Bringing Native PyTorch Support to TPU(2026-10-20, 15 posts)
- Episode 2: Meta runs AI inference on Google TPUs in production(2026-10-21, 2 posts)
- Meta engineer confirms Google TPUs now run AI inference in Meta production — dotey · 2026-10-21
- SGLang-TorchTPU launches with Google and Meta, hits 770 tok/s decode in production — ying11231 · 2026-10-22