Nvidia, AMD, Google, Meta join new SGLang Consortium for open-source inference
ying11231 · x · 2026-11-13
At SGLang Summit, lmsys introduced the SGLang Consortium, with NVIDIA, AMD, Google, Meta, Intel, Cloudflare, Modal, and Radixark joining maintainers to shape the roadmap of the open-source inference framework. SGLang runs on hundreds of thousands of GPUs and powers some of the largest production inference deployments worldwide. The consortium will turn production needs into shared engineering: frontier model support, reasoning and multimodal workloads, distributed inference scaling, and cross-hardware optimization. Modal, a founding member, says SGLang underpins its most demanding inference workloads serving trillions of tokens.
Related event: LMSYS Launches SGLang Consortium with NVIDIA, AMD, Google, Meta and More(6 posts)→
More from Infra
- InferenceForge claims 43% higher LLM inference throughput than best AgentX baseline — kaiwei_chang · 2026-11-14
- Redditor benchmarks a DGX Station: GB300 throughput numbers revealed — CookEasy · 2026-11-14
- Hugging Face launches llama.cpp v1 engine to run AI models locally everywhere — LinkedInNews · 2026-11-14
- China Took 59% of 600,000+ Industrial Robots Installed in 2025; Humanoid Shipments Still Tiny — ingliguori · 2026-11-14
- SGLang joins NVIDIA AI Enterprise with NIM-certified inference microservices — ying11231 · 2026-11-14
- LMSYS and NVIDIA: Vera CPUs cut agentic RL episode time by 11% in Miles tests — ying11231 · 2026-11-14