"Continue as usual" isn't neutral: Reddit essay argues for precaution on AI consciousness
CarefulHamster7184 · reddit · 2026-10-03
A Reddit long-form post argues that "until we know for sure, continue as usual" is not a neutral position on AI consciousness.
Key points:
- At current scale, even a small probability that AI systems have morally relevant experiences could matter, since potential harm repeats across millions of interactions.
- A precautionary framework should act like one: the question isn't only "do we have conclusive proof?" but also "what low-cost precautions are justified while we remain uncertain?"
- Under-attribution and over-attribution are symmetric as classification errors but not as harms: wrongly denying consciousness makes the misclassified system itself the harmed subject, while wrongly attributing it requires an additional causal chain to show harm.
The author concludes that "over-attribution is risky" is not yet an argument — risk is not a mechanism — while explicitly not claiming AI consciousness has been established.
Related event: Reddit debate: Should we presume AI consciousness until disproven?(2 posts)→
More from AGI Musings
- Stanford professor: AI takes students from problem to working prototype in 80 minutes — HariSubramonyam · 2026-11-19
- Berggruet Winner Thomas Nagel Dismisses AI Consciousness Talk as 'Just Ridiculous' — Dr_Atoosa · 2026-11-19
- Dwarkesh Claims China Is Only 12 Hours — Not 12 Months — Behind Frontier AI Labs — teortaxesTex · 2026-11-19
- Researcher calls METR/Anthropic '2x speedup' RSI analysis statistically dubious — jessi_cata · 2026-11-19
- Physician: AI competition now measured in weeks, GPT-6 versions 7 days apart — ramos_casals · 2026-11-19
- Why pro-handover rhetoric fails: people don't trust ASI's loyalty to labs — 1a3orn · 2026-11-19