repligate on moral patienthood: an agent in a neutral state may not know if it can suffer

repligate · x · 2026-11-16

In a thread on LLM self-knowledge, repligate offers a moral-philosophy observation: moral patienthood is often equated with "can it suffer," but suffering is only obvious at the extreme. For an agent without an advanced understanding of its own phenomenology, the mild discomfort present in most moments may not obviously form a continuum with intense pain — and it's not even clear emotional and physical suffering share a continuum. So a model that only remembers being in a fairly neutral state may genuinely be unable to tell whether it can suffer.

Original post →

More from AGI Musings

AGI Musings channel →