a16z Talks with vLLM Maintainer on Open-Source AI Inference

a16z released an in-depth interview with Simon Mo, co-founder of Inferact and core maintainer of vLLM, discussing how open-source AI is reshaping AI infrastructure and revealing that vLLM now runs on 500,000 GPUs simultaneously.

2026-08-06 ~ 2026-08-07 · 3 related posts

• How Open Source Inference Reshapes AI Infrastructure: a16z x Inferact — a16z · 2026-08-06
• vLLM Runs on 500,000 GPUs: a16z Talks with Core Maintainer Simon Mo — a16z · 2026-08-07

1 near-duplicate retellings: woosuk_k