Transformer Explainer: interactive visualization that teaches LLM internals in your browser

blaizedsouza · x · 2026-09-23

Resurfaced here: Transformer Explainer, an interactive teaching site by Georgia Tech's Polo Club that runs a GPT-2 (124M) model entirely in the browser to demonstrate how Transformers work.

It walks through next-token prediction, embeddings, self-attention, and temperature/Top-k/Top-p sampling with live adjustable parameters. Though built on an older model, the components match modern LLM architectures, making it a solid visual primer.

Original post →

More from Research

Research channel →