Burkov's Hundred-Page Language Models Book details three architectures with PyTorch code
burkov · x · 2026-10-19
Andriy Burkov, author of The Hundred-Page Machine Learning Book, released The Hundred-Page Language Models Book: Hands-on with PyTorch, calling it "the best book on language models." It explains in detail three architectures still used in practice — count-based, RNN-based, and transformer — with diagrams and code.
More from Research
- 93-Model Benchmark Over 1.5 Years: Distillation + Quantization + RL Hurts General AI — Afinetheorem · 2026-10-19
- Tononi and Koch argue IIT implies humans have genuine free will, not an illusion — burny_tech · 2026-10-19
- Forward-only pretraining speedup of 2.3x verified, inspired by interpretability essay — burny_tech · 2026-10-19
- Steering single neurons gives Qwen3-8B vivid first-person "inner voice" outputs — Sauers_ · 2026-10-19
- Steering a single trained neuron makes models claim they're Claude, experiment shows — Sauers_ · 2026-10-19
- Berkeley-led paper: making LLM agents 'forget' history yields up to 39% gains in discovery tasks — burny_tech · 2026-10-19