Stanford CS336 Spring 2026: Learn to Build an LLM from Scratch with Public Assignments
stanfordnlp · x · 2026-10-03
Stanford's CS336 (Language Modeling from Scratch), taught by Percy Liang and Tatsunori Hashimoto, has published its Spring 2026 syllabus with publicly available materials for self-study.
- Coverage: the full pipeline from tokenizer to training and evaluation, including transformer basics, GPU optimization, scaling laws, data cleaning, and reasoning RL.
- Approach: OS-course-style, students build their own LM end to end — data collection/cleaning, model construction, training, evaluation — with implementation-heavy assignments.
- Prerequisites: strong Python and PyTorch plus ML/math foundations; GPU compute is separate, and the course recommends debugging correctness on CPU before paid training runs.
- Lecture recordings are on a YouTube playlist; assignment links are public.
More from Companies & People
- Palo Alto Networks buys OpenAI-alumni startup Applied Compute for $4.5B — KateClarkTweets · 2026-11-19
- FT: US tech outages blamed on rush to fix bugs found by AI — nordicinst · 2026-11-19
- Stanford professor: AI takes students from problem to working prototype in 80 minutes — HariSubramonyam · 2026-11-19
- marclou launches $100K hackathon: build a profitable startup in 30 days — marclou · 2026-11-19
- Activists to rally outside Anthropic HQ demanding a ban on recursive self-improvement — DavidSKrueger · 2026-11-19
- Reported: Musk offers NVIDIA engineers a path to SpaceX's Terafab if Huang exits — inductionheads · 2026-11-19