Mech interp may be missing the backward pass, where learning is most explicit
joshua_saxe · x · 2026-07-26
The author argues that much mechanistic interpretability work focuses on intelligence in the forward pass or static weights, but important structure may live in the backward pass during training.
They suggest gradients and backpropagation are philosophically interesting because they capture learning most explicitly, and may deserve more attention from interpretability researchers.
More from Research
- Stanford Data-Centric AI Workshop reopens site, extends poster deadline — jure · 2026-10-26
- 'Vibe verification': ~60% of AI-written formal specs prove the wrong property — basedjensen · 2026-10-26
- Ito: a browser that detects browsing intent and auto-organizes tabs into Flows — andrewkuznet · 2026-10-26
- Cornell study says brains process language as linear sequences, challenging Chomsky's hierarchy — anirbanbandyo · 2026-10-26
- Hi3D V1.0 open-sourced with 2M training assets and 90% slicing success rate — kimmonismus · 2026-10-26
- Ortet evaluates 34 open-weight models on 50 health tasks, finds general leaderboards insufficient — elmanmansimov · 2026-10-26