Andriy Burkov's 'Hundred-Page Language Models Book' praised for technical depth

burkov · x · 2026-08-26

Andriy Burkov's "The Hundred-Page Language Models Book" is highly recommended for its technical density without fluff. It covers everything from basic ML and RNNs to Transformers and modern LLMs, including mathematics and PyTorch implementations. The Transformer chapter is noted for its progressive breakdown of self-attention and architecture. Burkov offers a "read first, buy later" model with online chapters and notebooks, making it a solid choice for those seeking a mechanistic understanding beyond just using APIs.

Related event: Andriy Burkov Releases The Hundred-Page Language Models Book(2 posts)→

Original post →

More from Research

Research channel →