Casper: Understanding 90% of neurons ≠ understanding the network
StephenLCasper · x · 2026-10-16
AI researcher Stephen Casper argues that equating "understanding all the neurons" with "understanding the network" is clearly wrong: understanding 90% of the behavior of 90% of neurons does not translate to understanding 81% of the network, because errors compound in complex systems. The remark adds to the ongoing debate over whether mechanistic interpretability can truly explain how neural networks work.
More from AGI Musings
- Ben Affleck calls AI 'just matrix multiplication'; Grady Booch echoes the skepticism — Grady_Booch · 2026-10-16
- Everyone has a precise AGI definition—until a model gets close to meeting it — VraserX · 2026-10-16
- Viral take: If AI gives us time back, its greatest gift is revealing what we mistook for the cost of living — r0ck3t23 · 2026-10-16
- "AI automation = slop, AI augmentation = super intelligence" — the line CEOs should see — jacob_posel · 2026-10-16
- Reddit take: Building a successor AI species would itself be humanity's purpose fulfilled — Flashy-Disk311 · 2026-10-16
- When Simple Rules Beat AI: A Frozen Ride-Hailing State Machine at Dulles — shashib · 2026-10-16