Run GPT-2 in Your Browser: Interactive Tool Visualizes the Full Transformer Pipeline
techNmak · x · 2026-11-11
A recommendation for Transformer Explainer by poloclub: an interactive educational tool that runs a small GPT-2 model (124M parameters) live in the browser, letting you watch the full pipeline as you type a sentence.
- Step through tokenization → embeddings → Q/K/V → attention → MLP → logits → next-token probabilities
- Inspect attention maps and intermediate activation values
- Tweak temperature, top-k, and top-p sampling to see how generation changes in real time
The poster's take: if Transformers still feel like boxes connected by arrows to you, this is worth opening.
More from Apps
- Google Labs launches Tabletop, an AI experiment that builds custom shared spaces on demand — GoogleLabs · 2026-11-12
- Developer builds VladOS, a personal life dashboard, by just describing it to an AI agent — haltakov · 2026-11-12
- Typeless partners with Anker on soundcore Work wearable mic to replace typing — CurieuxExplorer · 2026-11-11
- Coinbase ships override-proof guardrails for AI trading agents — MurrLincoln · 2026-11-11
- Premiere Pro's Generative Remove enters public beta: erase tracked objects from video — jnack · 2026-11-11
- Grok @bot lets you screenshot suspicious texts and verify scams instantly — Baconbrix · 2026-11-11