Interpretability won't save us: critics call superintelligence project reckless regardless
zetalyrae · x · 2026-10-16
A debate on AI safety: GroundhogStrat argues that even if interpretability were solved, catastrophic accidents could still occur — civil engineering is mature yet bridges still collapse, and a fully interpretable AI could still make a catastrophic mistake in a bio lab. TheStalwart adds that beyond rogue behavior, the deeper worry is extreme concentration of power: creating strong AI itself may plausibly lead to it.
More from AGI Musings
- 'We spent a century teaching people to think like machines — now the machines are here' — r0ck3t23 · 2026-10-16
- Redditor defines AGI/RSI/ASI concretely, claims GPT-6 'Astra' already crossed the line — Crayola_God · 2026-10-16
- AI ownership may create abundance humans lack the income to access — PierceLilholt · 2026-10-16
- The Gap Between Very Good and Great: 1 in 100K Fills a Stadium, 1 in 100M Fills a Room — dbasch · 2026-10-16
- ICLR reviewer says 4/5 papers in review pile read like AI slop — berkustun · 2026-10-16
- Turing laureate David Patterson: 99% of science discoveries will be made by AI by end of next year — davidpattersonx · 2026-10-16