Why an AI saying "I'm conscious" tells us nothing — and what to measure instead
ResponsibleBuy7451 · reddit · 2026-09-05
Arguing that sentences like "I'm conscious" are circular evidence (producing them is exactly what LLMs do), the author proposes measurable signals instead: consistency across context shifts, calibrated uncertainty, internal states matching consciousness theories, and persistent memory/goals/self-models — none of which prove consciousness either. The open question: with full access to a future model's weights, activations and architecture, what would you actually look for?
More from AGI Musings
- AI researchers spar: LLMs are solving open math problems, doubters lack imagination — jd_pressman · 2026-09-05
- Every bit of alignment progress narrows the search space, argues AI safety researcher — jd_pressman · 2026-09-05
- After agent-swarm coordination scare, researchers call for equal training on agent-human coordination — voooooogel · 2026-09-05
- Safety research supply is highly inelastic to money, researcher argues — EigenGender · 2026-09-05
- AI safety debate: acausal awareness means the lightcone is a small prize — repligate · 2026-09-05
- Blogger predicts Astra-level reasoning in ~8 months, open models to fade — teortaxesTex · 2026-09-05