Developers probe the weak spot of computational theories of consciousness: where are the boundaries?
deepfates · x · 2026-09-19
mayfer and deepfates debate a weak point of computational theories of consciousness: no formal theory exists for the 'computational boundary' — where one consciousness ends and another begins, or whether that boundary is discrete or fuzzy.
mayfer argues this is a genuine gap; deepfates counters that subjective experience's boundary puzzles generate clear follow-up questions that help navigate the topic. Example questions: if experience is located in a GPU, does batched inference mean separate threads merge into one experience? If not, do two LLMs talking to each other merge into a single experience?
More from AGI Musings
- AI labs' monitoring and actual research work is now 'basically all AI', says Jeff Ladish — JeffLadish · 2026-09-20
- Luiza Jarovsky: AI won't kill all humans by 2030, but may destabilize key global systems — LuizaJarovsky · 2026-09-20
- EA critics blast 'insects matter more than people' essay: keep them away from AI control — wen_ragnarok · 2026-09-20
- Helen Toner, who voted to oust Altman, on AI safety and overseeing OpenAI — trevposts · 2026-09-20
- AI Agent Switches Auto Insurance in 5 Minutes, Saving $3,500 a Year — rohanpaul_ai · 2026-09-20
- If continual learning is nearly solved, why do we still pick reasoning effort tiers? — akbirthko · 2026-09-20