New paper: AI interpretability methods can hallucinate findings like the dead salmon fMRI

kchonyc · x · 2026-11-23

A new arXiv paper argues interpretability methods (feature attribution, probing, SAEs, causal analyses) can produce plausible explanations even for randomly initialized networks, and proposes reframing explanations as statistical parameters inferred from computational traces, with uncertainty quantification and identifiability analysis to guard against false discoveries.

Original post →

More from Research

Research channel →