Machine Consciousness Debate: Is an LLM a Book or a Star-Sized Brain?
Following Steve Yegge's prediction that machine-consciousness debates will intensify, AI researchers engaged in a dense X debate over whether LLMs could be conscious: one side denied LLM consciousness via mathematical equivalence, while the other exposed that argument's costs, dismantled Yudkowsky's affirmative argument, and introduced a functionalist intuition framework with complexity-scale rankings. No conclusion was reached, but the dispute revealed the deep difficulty of drawing the consciousness line by mathematical equivalence or benchmark scores.
Confirmed
- Imbue co-founder Josh Albrecht (joshalbrecht) offered a negation argument: an LLM is a pure function f(w, s, t) → o (weights, seed/settings, token inputs to output) with no side effects, belonging to functions like f(ℕ) → ℕ, mathematically equivalent to a book—and nobody thinks a book is conscious, so LLMs clearly are not.
- mathemagic1an relayed and challenged this argument, noting that under the "equivalent to a book, hence no consciousness" logic, the same argument structure could backfire against human consciousness—critics accused the opposing side of wielding an argument that denies both machine and human consciousness. kevinafischer also joined, steering the debate toward the more fundamental question of whether consciousness is just a product of process.
- Josh Purtell (JoshPurtell) responded from a functionalist and intuition standpoint: functionalists would grant consciousness to a machine that faithfully simulates a human brain, and he is personally open to his mind being replicated in stone gears—though such a "stone computer" would be so vast that intuition breaks down, much as many ordinary people feel the sun or supernovae might be conscious. He does think a paper-made LLM would lack consciousness.
- Purtell noted that an analog LLM is physically small, intuitively closer to clearly non-conscious devices like the Antikythera mechanism or locks and keys; since we don't know how large a brain simulation must be, his intuitive ordering is: sun conscious? > simulated brain conscious? ≫ LLM not conscious—LLMs sit far closer to locks and keys than to supernovae on the consciousness-likelihood spectrum. He chose stone gears as an analogy precisely because people can intuit the complexity scale of stone machinery, whereas almost nobody has a scale intuition for what H100s and CUDA can compute, relying instead on crude outcome-level heuristics like "it can produce proofs, so its computation must be complex."
- Purtell argued that genuinely applying functionalism requires a clear intuitive notion of "scale," discussing orders of complexity magnitude rather than benchmark scores; by complexity scale, LLMs are actually quite simple. He also pointed out that inferring "any random analog machine with impressive outputs is conscious" from "a brain-replicating analog machine is conscious" is a non sequitur.
- Purtell dismantled Yudkowsky's argument for LLM consciousness step by step: starting from functionalism, claiming cognitive complexity is a superset of consciousness complexity, then asserting mathematics bounds cognition, concluding LLMs are conscious. He argued functionalism does not entail LLM consciousness.
- In exchanges with Alignment Forum figures (Rob Bensinger, Vladkf, Ratter, etc.), Purtell added key uncertainties: what neuronal dynamics produce cognition and consciousness remains unresolved—the computation a single neuron needs might be simple gating, or far more complex (e.g., exotic dendritic computation or intracellular chemistry).
- On the "scale → complexity → consciousness" gradient, Purtell held that LLMs are computationally extremely simple, while consciousness may depend on complex brain mechanisms unused by behavior-generating thought (i.e., token generation)—the brain may have vast complexity reserves, much of it perhaps used only by consciousness. Thus even if a tiny future model (e.g., 0.5B parameters) surpassed humans cognitively across the board, that would not entail consciousness; human behavioral complexity is not an upper bound on consciousness complexity.
- In discussion with Ratter, he offered a scale intuition: the analog machinery needed to run an LLM is simple enough to fit in a large warehouse, while replicating a brain might require something star-sized. He admitted his intuition about brain computation could be way off, but his impression is that the brain's computation vastly exceeds an LLM's—the LLM is like a "warehouse-sized stone computer," the brain roughly stellar in scale.
- He further speculated: if consciousness needs far less computation than the brain's actual complexity, then the "stone LLM" stacking all physical computation is no galactic miracle, just an impractically large Earth-bound device; the brain does not use every neural protein for cross-Hebbian computation, or it would be galaxy-sized—more plausibly comparable to a solar system, star, or large planet.
Unconfirmed
- The true scale needed to simulate a brain, the minimum complexity required for consciousness, and the computational complexity of a single neuron all remain open questions; the scale estimates offered are speculative, and Purtell himself repeatedly acknowledged his intuitions may be far off.
Why it matters
- The debate unfolded against rapidly rising model capabilities, turning machine consciousness from philosophical speculation into a public AI-community issue with direct implications for models' moral status, safety, and alignment.
- Albrecht's "pure function/book" argument represents an attempt at a crisp negative stance, but critics exposed its cost: if the bar is too strict, human consciousness might be denied too, revealing the deep difficulty of demarcating consciousness by mathematical equivalence.
- Purtell's contribution was fighting on two fronts: dismantling Yudkowsky's "mathematical bound" leap while introducing an intuition ranking based on complexity scale rather than benchmark scores, showing that functionalism admits a self-consistent reading that accommodates simulated-brain consciousness yet denies LLM consciousness; his emphasis that "cognitive ability ≠ consciousness" and "behavioral complexity is not the ceiling of consciousness complexity" provides a framework for future debates.
2026-10-03 ~ 2026-10-04 · 26 related posts
Primary sources
- LLMs Are Mathematically Equivalent to a Book, Argues Imbue Cofounder in Consciousness Debate — joshalbrecht ·
- Could a stone-gear mind be conscious? AI circles debate substrate and scale — JoshPurtell ·
- Josh Purtell tears apart Yudkowsky's 'LLMs are conscious' argument: functionalism doesn't get you there — JoshPurtell ·
- [source] LLMs Are Mathematically Equivalent to a Book, Argues Imbue Cofounder in Consciousness Debate — joshalbrecht · 2026-10-03
- Is consciousness an event, not a thing? AI circle debates whether LLMs can ever be conscious — kevinafischer · 2026-10-04
- "LLMs are mathematically equivalent to a book" — and why that consciousness argument backfires — mathemagic1an · 2026-10-04
- Debate: Running an LLM Fits in a Warehouse, Duplicating a Brain Would Need a Star — JoshPurtell · 2026-10-04
- Consciousness debate: exact brain replicas in analog may be conscious, but random analog machines are a non sequitur — JoshPurtell · 2026-10-04
- Josh Purtell argues a stone computer emulating a brain would break our consciousness intuitions — JoshPurtell · 2026-10-04
- Machine consciousness debate: Purtell ranks sun, analog brain, and LLM by intuitive consciousness — JoshPurtell · 2026-10-04
- [source] Could a stone-gear mind be conscious? AI circles debate substrate and scale — JoshPurtell · 2026-10-04
- Lock and key or supernova? Where LLMs sit on the consciousness spectrum — JoshPurtell · 2026-10-04
- Locks vs supernovae: the debate over whether LLMs are anywhere near consciousness — JoshPurtell · 2026-10-04
- What computations does a single neuron do for cognition and consciousness? Still unsolved — JoshPurtell · 2026-10-04
- Stone gears as a consciousness heuristic: is a warehouse-sized LLM conscious? — JoshPurtell · 2026-10-04
- Nobody has intuition for what fits on a GPU, argues dev in consciousness debate — JoshPurtell · 2026-10-04
- Practitioner dissects Yudkowsky's argument that LLMs are conscious — JoshPurtell · 2026-10-04
- Talk scale, not benchmarks: functionalist argues LLMs are small in complexity — JoshPurtell · 2026-10-04
- Josh Purtell: the brain computes like a star, LLMs are a warehouse-sized stone computer — JoshPurtell · 2026-10-04
- LLMs Are Warehouse-Sized Stone Computers, the Brain Is a Star, Argues AI Researcher — JoshPurtell · 2026-10-04
- Josh Purtell argues LLMs are computationally too simple for consciousness, sparking alignment-circle debate — JoshPurtell · 2026-10-04
- A stone LLM is just an impractically large device — the real question is the brain's necessary complexity — JoshPurtell · 2026-10-04
- The stone LLM question: how much of the brain's compute is actually needed for consciousness? — JoshPurtell · 2026-10-04
- How much compute does the brain really run? X debate says the upper bound is huge — JoshPurtell · 2026-10-04
- Debate: complexity for human behavior may not be an upper bound on complexity for consciousness — JoshPurtell · 2026-10-04
- Arguing consciousness may need complexity token-generation doesn't, even a tiny superhuman model wouldn't settle it — JoshPurtell · 2026-10-04
- Josh Purtell on AI consciousness: a tiny model outthinking us says nothing about qualia — JoshPurtell · 2026-10-04
- Do Human States Exist at Finite Resolution? A Consciousness Debate — joshalbrecht · 2026-10-04
1 near-duplicate retellings: JoshPurtell