Sasha Rush's Deep Learning Speedrun shows the minimal math to train MNIST

srush_nlp · x · 2026-10-29

Sasha Rush (co-author of the Transformer paper) answers his own question — what's the minimal amount of math you need to train an MNIST model? — pointing to his Deep Learning Speedrun tutorial as the answer. A streamlined path for readers wanting to get hands-on with training with minimal math background.

Related event: srush Derives MNIST from Peano Axioms in 3000 Lines of Lean(2 posts)→

Original post →

More from Research

Research channel →