Interactive atlas maps neurons across 20+ open LLMs, finding 323 homologous families
CatAstro_Piyush · x · 2026-11-21
shinboson released an interactive "Encyclopedia of LLM homologies": for each open-source model, MLP neurons that fire on the same text cluster together, and these clusters fall into the same 323 families in 18 kinds across every model analyzed.
Coverage includes Alibaba Qwen (up to Qwen3.8-27B with 1.11M neurons), Microsoft Phi-4-mini, Google Gemma, Hugging Face SmolLM, IBM Granite, Mistral, NVIDIA Nemotron, Falcon-H1, and Pythia snapshots at different training steps — with 85-100% of neurons assigned to a family. The shared template layout makes each family appear at the same position and color in every map.
More from Models
- DeepSeek-V4.1-Flash hits 59.5 tok/s on a single M5 Ultra at ~160W — AIFlow_ML · 2026-11-21
- Will MoE Inkling 2 Mini get strata support and rival dense Qwen on 12GB VRAM? — ECrispy · 2026-11-21
- Leaked Gemini App screenshot exposes internal reasoning and system prompt with teen safety rules — Bigwaliwigi · 2026-11-21
- OpenAI researcher hints at mystery model "Inkling" in babysitting tweet — yiwenyuan98 · 2026-11-21
- LlamaIndex benchmark: Gemini 4 Neon leads tables and visual grounding at 6.2¢/page — llama_index · 2026-11-21
- Inkling 2 Mini quantized to 13.9GB runs at ~60 t/s decode on a single RTX 4090 — indrasmirror · 2026-11-21