xuenay: objections to CEV were identified and addressed ~20 years ago

xuenay · x · 2026-09-09

AI researcher Kaj Sotala (xuenay) pushed back on alignment writer Raemon777's criticisms of CEV (Coherent Extrapolated Volition), arguing that the objections raised all seem to have been identified and addressed roughly 20 years ago.

He notes "addressed" may overstate it — really someone proposed it, people objected, and counter-objections were written — but maintains that Eliezer's 2004 paper and the later Arbital writeup seriously engaged these critiques. Raemon777 admitted it had been a while since he reread the CEV writeups and said he should revisit them before continuing the discussion.

Related event: Debate over CEV as Alignment Target: Sotala vs Raemon(6 posts)→

Original post →

More from AGI Musings

AGI Musings channel →