3-Hour Deep Dive with vLLM Core Dev: Open Source Infra and Model Co-design
vista8 · x · 2026-08-05
Background: The podcast Business Interviews released a 3-hour deep dive with You Kaichao, a core maintainer of vLLM. Inferact, co-founded by You and evolved from the vLLM community, recently secured a $150 million seed round.
Key Topics:
- Open Source to Commercialization: Explores vLLM's journey from an algorithm paper to an open-source community and finally a company, detailing the choices faced along the way.
- Model and Infra Co-design: You compares hardware, models, and inference engines to natural resources, generators, and the power grid. He emphasizes the critical role of multi-party Co-design in maximizing efficiency today.
- Industry Insights: The interview touches upon the extreme pursuit of system performance optimization by teams like DeepSeek, and expresses firm optimism for the future of open-source models.
More from Companies & People
- a16z Co-Hosting Creative Coding Hackathon with Cursor — stuffyokodraws · 2026-08-05
- Cognition Hires Former Brex Chief Business Officer to Scale Devin Ecosystem — russelljkaplan · 2026-08-05
- Pixar Co-founder Edwin Catmull Joins Higgsfield AI Film Festival Jury — SimplyAnnisa · 2026-08-05
- Google Cancels AI Studio Mobile App One Day Before Launch Despite 800K Pre-Registrations — Polymarket · 2026-08-05
- SSI model reportedly coming in August,网友称“疯狂的一个月” — GabGarrett · 2026-08-05
- Ilya Sutskever's SSI reportedly plans to launch first model in August 2026 — soumitrashukla9 · 2026-08-05