Interpretability's two halves: how the sausage is made vs what the sausage is
thebasepoint · x · 2026-09-27
thebasepoint sketches a rough split in interpretability research: "how the sausage is made" vs "what the sausage is". Empirically the latter has mattered far more for understanding model behavioral issues, while the former is more beautiful; he estimates NLA is 90% the latter, noting it won't reveal how addition splits into mod-10 and magnitude components.
Related event: Anthropic Researchers Debate the Value of NLA Interpretability(10 posts)→
More from Research
- microVLA runs pi0.5 VLA training and inference on a 4GB RTX 3050, 2.5x latency cut — this_is_surabhi · 2026-11-16
- WebArena-Pro launches: 300-task multimodal web-agent benchmark across 20 apps — xhluca · 2026-11-16
- U-M's CrowdBark crowdsources dog videos to study canine communication with AI — radamihalcea · 2026-11-16
- Top 10 Eval Papers of 2026: verifiers, agent-as-a-judge, and audit of self-improvement — omarsar0 · 2026-11-16
- Koshien robot team shares control stack: nonlinear-opt trajectories hit ±1.2cm average error — 4310sy · 2026-11-16
- A diffusion model trained on CIFAR-10 re-images black hole M87* — and the ring persists — bravo_abad · 2026-11-16