François Chollet Recommends Book Chapters for Building LLMs from Scratch

fchollet · x · 2026-08-25

François Chollet recommends chapters 15-16 of "Deep Learning with Python" for anyone (17 or older) wanting to build LLMs from scratch. The code uses Keras and runs on JAX, PyTorch, or TF, with TF-data for streaming. Chapter 15 specifically features one of the best explanations of why dot-product attention works.

Related event: Chollet Recommends Chapters for Building LLMs from Scratch(4 posts)→

Original post →

More from Apps

Apps channel →