Interactive Map of GPT-2 Word Embeddings
Limp-Contest-7309 · reddit · 2026-07-19
This is an interactive map of the GPT-2-small word embedding space, optimized for mobile. Users can click on any token to view its nearest neighbors and navigate the graph; a search box allows direct jumping to specific tokens.
The page uses t-SNE to compress the embedding table of 32,070 letter tokens into 2D, connecting them with a minimum spanning tree to ensure every edge reflects a true nearest-neighbor relationship. The author emphasizes that the visualization requires no forward inference and is context-independent.
Related event: Interactive Tool Visualizes GPT-2 Token Embeddings(4 posts)→
More from Research
- Causal-only attention for non-generative tasks is wasteful, argues HF engineer — antoine_chaffin · 2026-09-11
- Catholic University of Chile researcher: scaling AI feedback is key to sustainable medical education — julianvarascom · 2026-09-11
- Nature paper images cellular activity across all organs, revealing body-wide circuits — arjunrajlab · 2026-09-11
- SignNet 1M Dataset Released for Sign Language Research — ducha_aiki · 2026-09-11
- ECCV26 Oral: Flow Matching Enables Single-Stage Multi-View Point Cloud Registration — ducha_aiki · 2026-09-11
- InFlux++ Method Released — ducha_aiki · 2026-09-11