Before GPU Engineering: free 56-chapter open notebook on GPU architecture
techNmak · x · 2026-11-01
A free, open-source learning resource called Before GPU Engineering — a structured digital notebook with 56 chapters across four phases, covering GPU architecture and performance engineering from the ground up.
Instead of jumping into CUDA or Triton, it first builds understanding of how GPUs execute programs, move data, and handle parallel workloads. Topics include CPU vs GPU architecture, warps/SIMT/thread blocks, registers/shared memory/HBM, compute-bound vs memory-bound workloads, kernel launches and race conditions, memory coalescing, occupancy and latency hiding, arithmetic intensity, and tiling/matmul.
More from Infra
- Intel EMIB packaging yield at 60-65% vs TSMC CoWoS's 98%, report says — rickasaurus · 2026-11-01
- SpaceX guides to $35B quarter as Grok Bot hits 800K paid weekly users — elonmusk · 2026-11-01
- "IaC is dead": AI will manage infra changes, and Datadog-style UIs may suffer — thedealdirector · 2026-11-01
- Switching to EPYC: 4x Faster Local LLM Decode with Full Tuning Notes — mrgreatheart · 2026-11-01
- Korea lost $1.1 trillion in market cap: how a memory-chip duopoly made KOSPI an AI-leveraged node — ChinaTalk · 2026-11-01
- Nvidia engineer on Open Agent Safety Platform: verifiable, monitorable agentic AI — LuizaJarovsky · 2026-11-01