Full Talk Slides Released: How Inference Engines Actually Work, End to End
zainhas · x · 2026-09-12
zainhas released full slides for his talk "How Inference Engines Actually Work", covering the complete lifecycle of a request: engine architecture, KV + prefix caching, continuous batching, PagedAttention, chunked prefill, sampling/detokenization, and agentic loops from inside the engine. A systems-level primer for engineers on inference stacks like vLLM.
Related event: Full Slide Deck Explaining How Inference Engines Actually Work Goes Public(4 posts)→
More from Infra
- TSMC reportedly raising CoWoS packaging prices up to 20% next year on AI chip demand — Beth_Kindig · 2026-10-31
- effect-harness on Cloudflare: run agent loops, tools and credentials on separate VMs — samgoodwin89 · 2026-10-31
- Google's Project Suncatcher boots TPU in orbit and beams back first AI response — sundarpichai · 2026-10-31
- Together AI launches Post-Training platform for agentic RL with tool-use environments — togethercompute · 2026-10-31
- General Compute raises $100M for inference capacity as CoreWeave stock hits 12-month low — YvesMulkers · 2026-10-31
- Analyst warns of unstable AI compute feedback loop as Kioxia's NAND price warning triggers flash crash — bookwormengr · 2026-10-31