NNterp Encyclopedia: a visual guide to every modern transformer architecture variant

davidbau · x · 2026-11-19

davidbau's team launched the NNterp Encyclopedia, a comprehensive visual guide to modern transformer architecture variations for interpretability research. Since NDIF exposes hundreds of open-weight models with wildly different architectures, the encyclopedia collects per-family block diagrams, quirks, and "what you should know" notes from an interp perspective. The screenshot shows DeepSeek-V3's block anatomy — 61 DecoderLayers, 128-head latent attention, and a 256-expert top-8 MoE — with every component hoverable/pinnable by its nnterp name.

Related event: NNterp 2.0 Launches with Unified Interpretability API and Tooling Ecosystem(5 posts)→

Original post →

More from Research

Research channel →