SGLang Summit 2026 agenda: LinkedIn serves ads ranking at 10K+ QPS on SGLang
DavidBennett__ · x · 2026-11-05
SGLang Summit 2026 runs Nov 12–13 at Fort Mason, San Francisco, gathering 2,000+ engineers around the open AI stack. Highlights: LinkedIn serving ads-ranking small models at 10K+ QPS with <80ms scoring latency; Meta bringing PyTorch to SGLang; Alibaba extending HiCache for long-running agents; Perplexity's minimalist trillion-parameter trainer; NVIDIA on Vera Rubin and Google on SGLang-TorchTPU; plus SGLang Omni for interruptible real-time conversation.
Related event: SGLang Summit 2026 Set for San Francisco in November(4 posts)→
More from Infra
- oMLX lets a second Mac boost prefill up to 2.9x on big-memory Macs — pcuenq · 2026-11-05
- FineWeb-30M speedrun record falls to 14.2s on one 8xH100 node, a 1.64x speedup — RobertTLange · 2026-11-05
- HydraDB: a Rust graph database that keeps state in S3 and treats query workers as disposable compute — JeremyCMorgan · 2026-11-05
- OpenSSH 10.6p2 released with a workaround for a critical vulnerability — Animux · 2026-11-05
- Microsoft rejects multibillion-dollar AI deal with UK's Nscale, FT reports — nordicinst · 2026-11-05
- Microsoft Details Running Coding AI Locally on 128GB RTX Spark Windows PCs Without Token Fees — lee_stott · 2026-11-05