From OSS to startups: how vLLM, SGLang and FlashAttention teams monetize inference research
AccBalanced · x · 2026-11-21
sonnetxu maps a new category of AI infra companies emerging from open-source systems research: vLLM → Inferact (enterprise inference software/support), SGLang → RadixArk (managed inference and RL infra), Orca/continuous batching → FriendliAI (high-performance inference platform), speculative decoding work → Novita AI (decoding speedups and model serving), open kernels research → Together AI (compiler, kernels, full-stack platform). Key point: OSS success gives credibility, distribution and a tech head start, but customers and business models diverge.
More from Venture
- Anthropic goes public at $83/share: $130B cash, $431B compute commitments, $77B supplier financing — LexSokolin · 2026-11-21
- Oracle, Intel, CoreWeave down more than Bitcoin: drawdowns from record highs compared — markjeffrey · 2026-11-21
- SEC probe into NVIDIA is exploring potential accounting issues, sources say — zephyr_z9 · 2026-11-21
- SpaceX's GPU financing grows to $44B, largest ever, to fund NVIDIA Vera Rubin chips — XFreeze · 2026-11-21
- Nvidia sheds $2.4 trillion in market cap in 45 days, overtaken by Alphabet — KyeGomezB · 2026-11-21
- Nvidia down over $2.5 trillion as critic alleges board self-dealing — Kyrannio · 2026-11-21