GPU MODE Lectures Repo: Start with Profiling, CUDA and GPU Architecture
techNmak · x · 2026-10-17
Entry 8 in an LLM inference learning list: the GPU MODE lectures repo (6.9k stars). The author recommends starting with lectures 1, 3, and 4, covering profiling, CUDA, and GPU architecture. The repository links recordings and supporting material.
More from Infra
- MiniCPM-V 4.7 runs locally at 100 tok/s using only ~3 GB of memory — NielsRogge · 2026-10-17
- Power-management chips: the invisible layer deciding AI data center energy efficiency — Olivier__OG · 2026-10-17
- MiniCPM-V 4.7 runs a 35B multimodal model in 3GB of memory, fully on-device — alifcoder · 2026-10-17
- Full FP8 n-gram table visibly improves local Qwen3.8-Flash-Next at zero speed cost — sillynoobhorse · 2026-10-17
- Local Nemotron 3.5 on one A100 hits 169 tok/s, processes 100 clinical notes for 2.4 cents — MaziyarPanahi · 2026-10-17
- NVIDIA's open-source AIPerf benchmarking tool and Triton GPU tutorials for inference measurement — techNmak · 2026-10-17