nanoGPT, but it trains inside a tweet: a tiny transformer you can train on your own device

Thom_Wolf · x · 2026-10-14

Thom Wolf (co-author of the original GPT paper) shares an experiment that squeezes nanoGPT training into a single tweet link. Open the HF-hosted page, press Train, and a tiny transformer starts from random weights and trains from scratch right on your phone or desktop, with a real training run shown on the page — pitched as the "GPU-poor final form".

Original post →

More from Fun

Fun channel →