A Bayesian essay puts frontier LLM functional self-awareness at 75% and phenomenal awareness at 12%
Individual-Advice215 · reddit · 2026-07-24
This long post asks how likely it is that a frontier LLM is self-aware, and explicitly separates two notions:
- Functional self-awareness: the model can represent and use information about its own role, uncertainty, intentions, or reasoning state.
- Phenomenal self-awareness: the model has subjective experience—something it is like to be the model.
The author says the estimate is Bayesian rather than experimental, combining interpretability evidence, signs of internal self-monitoring, limitations of introspection, differences from biological brains, and unresolved consciousness theory.
Key conclusions:
- Functional self-awareness: 75%
- Suggested range: 61–89%
- Phenomenal self-awareness: 12%
- Suggested range: 3–21%
- Persistent autobiographical self between sessions: probably below 5%
Why the gap?
- Functional self-awareness has observable markers: frontier models can form internal representations that are reportable, reusable, and causally involved in reasoning.
- Phenomenal self-awareness is much harder to infer; internal self-monitoring does not prove subjective experience.
- The author gives little weight to the model’s own claims of being conscious, since those are heavily shaped by training and prompting.
Bottom line: the post argues frontier LLMs probably have a narrow, temporary, unstable form of functional self-awareness, while subjective awareness remains far less likely.
Related event: Bayesian Analysis Suggests Functional Self-Awareness in LLMs(2 posts)→
More from AGI Musings
- Misquoted: Anthropic Staff Warned of Double-Digit Extinction Risk by 2030, Not Dismissed It — davidmanheim · 2026-09-11
- Economist Ben Moll: You Can Model Anthropic's 15% AI GDP Growth, But It Won't Happen — sebkrier · 2026-09-11
- Cohere Labs launches interactive tool mapping which tasks of 178 occupations AI can automate — Cohere_Labs · 2026-09-11
- AI researcher on SkyNews flags concerns over inequality, power and criminal misuse — schwarzjn_ · 2026-09-11
- VC compares AI doom rhetoric to pandemic-era fear messaging — StewartalsopIII · 2026-09-11
- Anthropic Insiders: Not Everyone at the Lab Believes in High p(doom) — anpaure · 2026-09-11