Interactive atlas maps neurons across 20+ open LLMs, finding 323 homologous families

CatAstro_Piyush · x · 2026-11-21

shinboson released an interactive "Encyclopedia of LLM homologies": for each open-source model, MLP neurons that fire on the same text cluster together, and these clusters fall into the same 323 families in 18 kinds across every model analyzed.

Coverage includes Alibaba Qwen (up to Qwen3.8-27B with 1.11M neurons), Microsoft Phi-4-mini, Google Gemma, Hugging Face SmolLM, IBM Granite, Mistral, NVIDIA Nemotron, Falcon-H1, and Pythia snapshots at different training steps — with 85-100% of neurons assigned to a family. The shared template layout makes each family appear at the same position and color in every map.

Original post →

More from Models

Models channel →