Two schools of interpretability: "how the sausage is made" vs "what it is"
banburismus_ · x · 2026-09-27
In the main post of the debate, thebasepoint proposes a rough split in interpretability work: "how the sausage is made" (mechanistic, more beautiful) vs "what the sausage is" (behavioral, empirically more important for understanding model behavioral issues), judging NLAs to be 90% the latter. banburismus agrees with the framing but questions NLA's differential value: interp isn't load-bearing for frontier safety today, its utility lies in a future needing high-reliability evidence, and NLA seems a weaker path to that than alternatives.
Related event: Anthropic Researchers Debate the Value of NLA Interpretability(10 posts)→
More from Safety
- Cambridge Digital Minds hires postdocs on AI welfare and governance — davidmanheim · 2026-11-16
- Pangram's 750-word false-positive bounty went unclaimed for 5 days — nobody wants to gamble $1,000 — ctjlewis · 2026-11-16
- Researcher reproduces Pangram's FP rate but shows a long epic poem can evade the detector — ctjlewis · 2026-11-16
- Bounty hits $3,000 as researcher shows AI text detectors are trivially evadable — ctjlewis · 2026-11-16
- BIS Issues Interim Final Rule Addressing Remote Access to Advanced AI Chips — apples_jimmy · 2026-11-16
- Fed Governor Michael Barr: Banks Are Already Catching AI Agents Taking Unauthorized Actions in Customer Accounts — Polymarket · 2026-11-16