vLLM at 94,235 GitHub stars: the high-throughput LLM inference engine keeps climbing
vllm-project · github · 2026-10-20
vLLM is trending on GitHub with 94,235 stars (+98 today). The Python high-throughput, memory-efficient inference and serving engine supports CUDA, AMD, Blackwell and TPU hardware, and serves models like DeepSeek-V3, Qwen3, Kimi, GPT-OSS and Llama, with MoE support.
More from Infra
- Chrome 155 ships JPEG XL: 30-50% smaller than JPEG with lossless JPEG transcode — banteg · 2026-10-20
- Polymarket: DeepSeek releases open-source tool to sharply cut AI inference compute costs — Polymarket · 2026-10-20
- Together, Fireworks, Prime Intellect and Modal are all converging on inference + RL training — NielsRogge · 2026-10-20
- NVIDIA GTC kicks off in Berlin with Jensen Huang keynote set for tomorrow — NVIDIAAI · 2026-10-20
- Hyperdrives CEO interview: cheaper power-dense electric motors via cooling breakthrough — MarvinTBaumann · 2026-10-20
- MiniMax H3 video generation runs on a single RTX 3060 12GB via GGUF quantization — Ok-Inevitable8391 · 2026-10-20