Attribution as a training objective: MAttr answers the Impossibility Theorems paper
aryaman2020 · x · 2026-09-24
The author frames MAttr's methodological stance: rather than axiomatically defined attribution outcomes, classic interpretability problems (like attribution) should be treated as training objectives optimized via gradient descent against the task of interest—directly answering the call of the "Impossibility Theorems" paper by Bilodeau, Jaques, Koh and Kim. The authors also see it as a more mechanistic complement to metamodels, sharing the same worldview.
More from Research
- Autonomous agent edits just 1,024 weights to lift Qwen3.5 0.8B from 7.4% to 37.4% on MATH-500 — VictorSanh · 2026-11-12
- MIT's Tegmark coins 'formal-washing': Signal protocol proof is far from complete — tegmark · 2026-11-12
- Signal formal verification hits 80%, Tegmark says Wired overstated completion — tegmark · 2026-11-12
- Category-theoretic framework asks: when does a physical system actually compute? — neurovium · 2026-11-12
- Radical Numerics brings genome language model Omnii-1 to the edge for biodefense — exnx · 2026-11-12
- Against 'verifiable vs. fuzzy': the real axis is how expensive tasks are to grade — dfrsrchtwts · 2026-11-12