Interactive Map of GPT-2 Word Embeddings
Limp-Contest-7309 · reddit · 2026-07-19
This is an interactive map of the GPT-2-small word embedding space, optimized for mobile. Users can click on any token to view its nearest neighbors and navigate the graph; a search box allows direct jumping to specific tokens.
The page uses t-SNE to compress the embedding table of 32,070 letter tokens into 2D, connecting them with a minimum spanning tree to ensure every edge reflects a true nearest-neighbor relationship. The author emphasizes that the visualization requires no forward inference and is context-independent.
Related event: Interactive Tool Visualizes GPT-2 Token Embeddings(4 posts)→
More from Research
- New review: how prefrontal cortex dynamics turn world models into flexible behavior — AnnaCiaunica · 2026-10-27
- LIBERO-MAX: Robot Policies Drop 11–26 Points When the World Changes Mid-Task — drmapavone · 2026-10-27
- Kolab Benchmark Uses Pro Screen Recordings to Show AI Agents Overestimate Collaboration Quality — minnesotanlp · 2026-10-27
- One BBQ Example Pushes LLM Fairness Scores Past 90%, EMNLP Paper Questions Benchmarks — radamihalcea · 2026-10-27
- Real2Sem2Real turns one phone video into 2,000+ robot demos, matching 150 teleop demos — Scobleizer · 2026-10-27
- Understanding MuonH (Hyperball) through weight norm geometry of scale-invariant networks — jasondeanlee · 2026-10-27