MIT interpretability paper drama: willdepue calls the hype 'misleading' but backs weight space programming

aryaman2020 · x · 2026-11-07

A spat over the viral MIT interpretability paper: willdepue says it was presented in a foolish, misleading way but is glad it got people excited about weight space programming, which he calls "really cool." aryaman pushes back that the post itself is fine and Twitter hype caused misreadings, and accuses willdepue of being overconfident about model internals, citing his earlier incorrect claims about attention.

Related event: Weight-space programming does 4-digit multiplication with 355 weights, no training(3 posts)→

Original post →

More from Fun

Fun channel →