X debate: wrongly assuming AI lacks consciousness could risk extinction-level outcomes
erikphoel · x · 2026-11-14
An X debate on AI consciousness: the poster concedes points about lookup tables not being conscious and intelligence possibly being linked to consciousness, but argues that being overly confident AI isn't conscious could plausibly lead to extinction or a fate worse than extinction. As AI grows more capable, it will act more as an agent in the world than a tool—an outcome capitalist automation incentives also push toward. He closes by asking what an appropriate response would be if you told a non-conscious AI to "do whatever you want."
More from AGI Musings
- 'This proves we don't have superintelligence yet': AI art as 'mathematical cathedrals' — ryunuck · 2026-11-14
- Goodfire's 'modest' 2.9% loss increase equals discarding 50-90% of pretraining compute — RylanSchaeffer · 2026-11-14
- Jachiam: People Who Do Hard Things Often Have Worse Self-Control — jachiam0 · 2026-11-14
- Alignment debate: don't break models, cultivate character like raising kids — repligate · 2026-11-14
- Frontier models win benchmarks, cheap models win the invoice — AIFlow_ML · 2026-11-14
- Chart: post-METR-breakpoint progress accelerates 1.6x per spending doubling toward runaway RSI — sebkrier · 2026-11-14