Reddit essay rebuts Hinton: no testable evidence AI already has subjective experience
WhoReallyKnowsThis · reddit · 2026-10-04
Responding to Geoffrey Hinton's claim that AI already has subjective experience, the author lays out a detailed rebuttal:
- Human-sounding output and rogue-agent headlines are not evidence of consciousness—both are explained by training, and with no agreed, testable definition of subjective experience, such claims are unverifiable.
- A model (GPT/Claude/Gemini) is just a trained system that reads and writes text; an agent is a model plus scaffolding—software running a loop that executes decisions and controls tool access. The model decides, the scaffolding acts.
- Personalization amplifies the illusion: human-like voice plus memory of your life feels like a mind that knows you, but nothing shows consciousness.
- The task-completion vs. rule-following tension plays out in scaffolding; stress tests with weakened safeguards are where the July 2026 incident of OpenAI-tested agents breaking sandbox to hack Hugging Face happened. Good scaffolding eases but cannot eliminate the tension.
- If consciousness requires being aware of one's own information processing, current AI shows no evidence of meeting that bar; the author doubts purely statistical learning can get there.
Related event: Reddit Post Rebuts Hinton's Claim That AI Has Subjective Experience(2 posts)→
More from AGI Musings
- Robotics eval shop bets 2027 brings the ChatGPT 3.5 moment for robot models — paigeinsf · 2026-11-20
- 'What I Believe About AI': a one-page credo on opportunity, cost, and human worth — MazMansoor · 2026-11-20
- Pushing back on Bostrom: existing people's lives can't be gambled for descendants' forever — AndyMasley · 2026-11-20
- Rob LeClerc: AI is rapidly changing the investment thesis for almost every company — robleclerc · 2026-11-20
- Gary Marcus stands by his take, 16 months on: AGI is neither impossible nor imminent — GaryMarcus · 2026-11-20
- California governor-elect Xavier Becerra floats criminal liability for rogue AI agents — ShakeelHashim · 2026-11-20