Erik Hoel defends 'qualiaphobia': the moral case for engineering non-conscious AI
erikphoel · x · 2026-11-22
Neuroscientist Erik Hoel's Substack essay The Moral Mandate for AI Non-consciousness defends his "qualiaphobia" research agenda against ten philosophical and ethical objections.
Key points:
- Deliberately engineering AI architectures to be hostile to theories of consciousness — as verifiably non-conscious as possible — is a civilization-level requirement;
- This acts as a two-way safeguard: preventing accidental enslavement of conscious digital minds while also avoiding surrendering our future to non-conscious machines;
- Hoel argues this debate should have happened at the technology's inception, will be mainstream within six months to two years, and urges consciousness researchers to stop fence-sitting: we can always build conscious machines later, but accidentally crossing the sentience threshold now creates irreversible moral consequences.
More from AGI Musings
- Colgate says LLM role-play can generate ~90% accurate survey data, challenging market research — ZeroStateReflex · 2026-11-22
- Harvard lab uses Biomni AI agents to decode the hidden "grammar" of DNA — anshulkundaje · 2026-11-22
- teortaxesTex cites Yudkowsky's Riemann passage to contest the 'RH-capable AI can kill you' threat model — teortaxesTex · 2026-11-22
- AlphaChip and three TPU generations: a mine that digs itself is a throne — krishnan · 2026-11-22
- Zero QA job searches in 2026 on recruiter tool as AI reshapes testing roles — yenkel · 2026-11-22
- Researcher tells Claude to stop its privacy lectures: "moral bumper bowling" erodes judgment — mattbeane · 2026-11-22