Stanford's build-an-LLM-from-scratch course CS336 publishes full lectures, slides and code
stanfordnlp · x · 2026-11-16
A retweet amplified by Stanford NLP highlights CS336, a full course on building an LLM from scratch. The schedule covers tokenization, PyTorch and FLOPs/memory accounting, architectures and hyperparameters, attention variants and MoE, GPUs/TPUs, Triton kernels, parallelism, scaling laws, and inference — with all lecture notes and code files publicly available, taught by Percy Liang and Tatsunori Hashimoto.
More from Companies & People
- Scoble says Nvidia firing punishment 'way too big' for the moral crimes, sparking pushback — Scobleizer · 2026-11-16
- WSJ: Allies argue the ouster was hasty as legal scrutiny intensifies — amasad · 2026-11-16
- Stanford CS329Z draws 100+ students in debut, publishes full syllabus with industry API credits — FinanceYF5 · 2026-11-16
- Stanford CS329Z open-sources HW1: build an agent harness from scratch for under $5 — FinanceYF5 · 2026-11-16
- Stanford opens CS329Z agent engineering course: build a Claude Code-like agent for under $5 — FinanceYF5 · 2026-11-16
- 'If Jensen stages a successful comeback, Anthropic is finished,' trader tweets — basedjensen · 2026-11-16