Red Hat live session: vLLM core maintainer breaks down inference performance knobs
AccBalanced · x · 2026-11-18
Red Hat AI is hosting a live session on Nov 18, 2pm ET on mastering AI inference performance at scale, featuring vLLM core maintainer Tyler Michael Smith and Yuchen Fama. Topics: parallelism, scheduling, KV cache offloading, and prefill/decode disaggregation — and when each optimization actually pays off.
More from Infra
- Stratechery: Nvidia's earnings are a statement; Microsoft and Anthropic ship dueling AI OS updates — Stratechery · 2026-11-18
- Codeberg goes dark: domain vanished, pages unconfigured — jedisct1 · 2026-11-18
- All hyperscalers but Microsoft post negative FCF as AI capex peaks — marlene_zw · 2026-11-18
- Codeberg's domain mysteriously vanishes from its registrar account, site down — kingslyj · 2026-11-18
- Tokkey debuts thumb-sized AI hardware to run local models on your Mac — TejasKumar_ · 2026-11-18
- Hugging Face ships caching and serving upgrades, TTFT 1.5x faster — osanseviero · 2026-11-18