Interactive Map of GPT-2 Word Embeddings
Limp-Contest-7309 · reddit · 2026-07-19
This is an interactive map of the GPT-2-small word embedding space, optimized for mobile. Users can click on any token to view its nearest neighbors and navigate the graph; a search box allows direct jumping to specific tokens.
The page uses t-SNE to compress the embedding table of 32,070 letter tokens into 2D, connecting them with a minimum spanning tree to ensure every edge reflects a true nearest-neighbor relationship. The author emphasizes that the visualization requires no forward inference and is context-independent.
Related event: Interactive Tool Visualizes GPT-2 Token Embeddings(4 posts)→
More from Research
- Stanford Team Introduces Gigatoken, the World's Fastest Tokenizer — StanfordAILab · 2026-07-22
- Tabul AI launches Metal TreeSHAP to speed up Shapley values on Apple silicon — Scobleizer · 2026-07-22
- Reddit points to OpenAI’s ChatGPT Ads page — EcstaticAsparagus509 · 2026-07-22
- Open-source runtime lets each repo define its own AI code reviewer — ibabufrik · 2026-07-22
- DeepSWE: A New Benchmark for Evaluating AI Coding Agents on Real GitHub Issues — pmz · 2026-07-22
- A Rust space-economy sim runs hundreds of autonomous ships, built with Claude — kalcode · 2026-07-22