NNterp Encyclopedia: a visual guide to every modern transformer architecture variant
davidbau · x · 2026-11-19
davidbau's team launched the NNterp Encyclopedia, a comprehensive visual guide to modern transformer architecture variations for interpretability research. Since NDIF exposes hundreds of open-weight models with wildly different architectures, the encyclopedia collects per-family block diagrams, quirks, and "what you should know" notes from an interp perspective. The screenshot shows DeepSeek-V3's block anatomy — 61 DecoderLayers, 128-head latent attention, and a 256-expert top-8 MoE — with every component hoverable/pinnable by its nnterp name.
Related event: NNterp 2.0 Launches with Unified Interpretability API and Tooling Ecosystem(5 posts)→
More from Research
- SE3 Labs Releases First Open YAM Real-Robot Teleop Dataset: 500 Bimanual Episodes — paigeinsf · 2026-11-19
- 1.5 years under review: researchers urge releasing AI papers immediately after submission — carlosdponx · 2026-11-19
- Berkeley's StreamEmbed indexes your screen history on-device, 3.7x faster at matched accuracy — berkeley_ai · 2026-11-19
- NAACL RAF opens 2026-2027 grant proposals for NLP initiatives, due May 6 — keviv9 · 2026-11-19
- Open-sourced Indic profanity detector covers 12 Indian languages, runs at 4ms per comment on CPU — sudalairajkumar · 2026-11-19
- MAVE reconstructs editable 3D blockouts from film shots, works inside Blender — bdsqlsz · 2026-11-19