Commentator: Superposition Theory and InceptionV1 Rebuttal Research Programs Are Irreconcilable
teortaxesTex · x · 2026-10-16
- teortaxesTex states that in the interpretability dispute over the InceptionV1 rebuttal, the two sides' research projects are "irreconcilable" with nothing left to clarify.
- The attached analysis shows Liv attributes extra superposition to fixable architectural bottlenecks, while Nick argues this is post-hoc theorizing, with "size" ambiguously defined between them.
- Both use courtesy to make the clash look smaller: Nick's reply effectively rejects the ontology superposition theory presupposes, and claims the field's main practical inference was wrong — at odds with his own "almost all steps were reasonable" framing.
- The deep question — whether "feature" is a measurable property or a flexible human description — will only be settled by which research program keeps producing circuits with predictions that hold.
More from AGI Musings
- DHH: Starship, Starlink and Grok should have been Europe's Sputnik moments — georgemillo · 2026-10-16
- Hinton hits back at Jensen Huang: 'He has good reason to say AI isn't dangerous — he sells Nvidia chips' — BlackHC · 2026-10-16
- Yudkowsky blasts new interpretability finding as primitive; critic pushes back on doomer logic — AlexTensor · 2026-10-16
- Beff Jezos declares 'civilizational inflection point' in the acceleration of technological progress — beffjezos · 2026-10-16
- Data scientist: pivoting to AI engineering is the safest career bet for the next 5 years — mdancho84 · 2026-10-16
- AI will be superhuman at science regardless, and Europe can't opt out — teortaxesTex · 2026-10-16