10 free resources for learning LLM inference engineering, from Stanford CS336 to vLLM
techNmak · x · 2026-10-17
techNmak curated 10 free resources for learning LLM inference engineering — how to serve more users, respond faster, and fit within GPU memory.
- LLM Inference Handbook (Modular)
- Hugging Face – Continuous Batching docs
- Stanford CS336 – Inference (2025)
- How To Scale Your Model – Inference
- MIT 6.5940 – EfficientML (2024)
- Inside vLLM – Aleksa Gordic
- Mini-SGLang
- GPU MODE – Lectures
- Triton – GPU Programming Tutorials
- NVIDIA AIPerf – Benchmarking Guides
The list spans concepts, code, and measurement, all freely accessible.
More from Infra
- OpenJet claims Qwen3.8-27B coding runs 1.9x faster than llama.cpp on one RTX 3090 — JeremyCMorgan · 2026-10-23
- Jensen Huang lays out NVIDIA's full Vera Rubin agentic system: NVL72, MGX, CMX and RTX — rohanpaul_ai · 2026-10-23
- ONNX to Transformers.js: running models directly in your browser — JosephJacks_ · 2026-10-23
- MiniMax M3.1 Flash free for 3 days on 0G, with 1M context and 512K output — MiniMax_AI · 2026-10-23
- "We bet on Cloudflare and it paid off": R2 and D1 at billion scale — dinasaur_404 · 2026-10-23
- Public data is drying up; private training data is turning into a browsable catalog — SucceededMind · 2026-10-23