Baseten's Philip Kiely releases 'Inference Engineering' book free online
philipkiely · x · 2026-09-14
Philip Kiely (Baseten) has made his book Inference Engineering fully readable online for free. The book guides engineers across the stack from CUDA to Kubernetes for faster, cheaper, more reliable generative AI serving. Kiely notes the field's evolution: only a few hundred inference engineers existed when ChatGPT launched, but 2M+ open models on Hugging Face (25x more than five years ago) from Mistral, Qwen, DeepSeek, Moonshot and others have made inference engineering an industry-wide discipline.
More from Infra
- Sandbox tip: bake dependencies into the image instead of pip-installing at runtime — xeophon · 2026-09-14
- US's No.2 law firm Latham & Watkins builds in-house AI stack with Nvidia servers — ayushtweetshere · 2026-09-14
- Oracle Cuts Double-Digit % of Some Teams While Hiring Aggressively for Data Centers and AI — mkheck · 2026-09-14
- Running Two Models Across Strix Halo + r9700 Hits OOM: Full Config Shared — El_90 · 2026-09-14
- Musk: AI will be 99% of SpaceX's value within four to five years — XFreeze · 2026-09-14
- Weaker enterprise HBM demand could finally normalize DRAM and NAND pricing, argues analyst — eyishazyer · 2026-09-14