Researcher argues ensuring AI stays non-conscious is the best future, citing asymmetries
erikphoel · x · 2026-11-19
The author criticizes consciousness researchers for fence-sitting on endless debates like the Chinese room, urging them to pick a future and work toward a good one. He argues that ensuring AI is non-conscious is by far the best current option, citing two asymmetries: (A) we can always choose to build conscious AI later, but the reverse is hard to undo; (B) non-consciousness is an easier target than "consciousness I treat well even while using it to make money".
Related event: Erik Hoel Defends Engineered Non-Conscious AI as Civilizational Goal(2 posts)→
More from AGI Musings
- AI may make customer-facing forward-deployed roles more valuable, not less — ivory_tang · 2026-11-19
- Ex-SOTA LLM builder: UK AI is held back by risk-averse capital and 'insane regulation' — rosstaylor90 · 2026-11-19
- Counter-take to "LLs have peaked": new models much better at long-horizon tasks — minhnguyen · 2026-11-19
- Running 15 AI Agents All Day Is Context-Switching Fatigue, IBM Engineer Explains — TejasKumar_ · 2026-11-19
- UK missed the frontier-model window? Debate over pivoting to today's AI opportunities — rosstaylor90 · 2026-11-19
- signull: AI products are text-optimized; visual experiences will be the next big shift — signulll · 2026-11-19