Alignment Researchers Push Back on CEV as Unproven and Risky

Kaj Sotala and others argued against adopting CEV as an alignment target, questioning whether the concept is coherent, achievable, or safer than minimal alternatives, and instead backing a proven 'wise advisor' approach over committing humanity's light cone to an untested idea.

2026-09-09 ~ 2026-09-09 · 4 related posts

• Debate: why CEV may be incoherent and riskier than simpler alignment proposals — xuenay · 2026-09-09
• Kaj Sotala argues alignment should favor wise-advisor designs over untested CEV — xuenay · 2026-09-09
• Should we hand the lightcone to a never-tested concept? CEV under fire — xuenay · 2026-09-09
• Researcher warns against CEV alignment: untested concept too risky to hand over the lightcone — xuenay · 2026-09-09