Free online book: LLM Inference Handbook for production deployment
burkov · x · 2026-11-18
Sherlock Xu's free online book LLM Inference Handbook (2026) is a practical reference for engineers deploying, scaling, and operating LLMs in production—covering model behavior, hardware selection, application interfaces, and ongoing operations. Readable as a guided progression or a lookup resource.
More from Infra
- SEC opens civil probe into Nvidia over undisclosed China-linked chip sales — The Decoder · 2026-11-18
- Open-source LLM Optimization Handbook: 48 topics with hands-on quantization, KV cache and kernel problems — udmrzn · 2026-11-18
- Nvidia stock barely moves after blowout quarter, investor holds off buying the day-one pop — bindureddy · 2026-11-18
- One HF Job, $127 total: Inkling-2-Small image generation under a tenth of a cent per picture — vanstriendaniel · 2026-11-18
- Voice agent team cuts P95 time-to-first-voice by 50% via single-datacenter migration — itsOmSarraf_ · 2026-11-18
- Satnam meets Prof. George Constantinides in Cambridge on UK AI infrastructure — satnam6502 · 2026-11-18