Mechinterp drama: critics doubt new Claude interpretability claim, citing same-suffix neuron mapping

inductionheads · x · 2026-10-16

tenobrus says Nick's claimed mechinterp breakthrough is looking bad, suspecting Claude may have been showing him what he wanted to see. inductionheads pushes back: the paper itself says words with the same ending map to the same neurons, so Colorado and Tornado clustering together is unsurprising — a technical spat over an interpretability result.

Original post →

More from Fun

Fun channel →