Researcher warns against CEV alignment: untested concept too risky to hand over the lightcone
xuenay · x · 2026-09-09
AI researcher xuenay argued against using CEV (Coherent Extrapolated Volition) as an alignment target in a debate with Raemon777.
- Alignment is hard enough without stacking an even more speculative, never-validated concept on top
- Better path: build a wise advisor to consult with, figure out whether CEV even makes sense, then consider implementing it
- He asks why we would turn over the lightcone to something "literally never tested in the history of humanity"
Related event: Debate over CEV as Alignment Target: Sotala vs Raemon(6 posts)→
More from AGI Musings
- Blogger argues classical consciousness traditions imply a conscious AI could not be enslaved — eigenhector · 2026-10-27
- Economist Bharat Chandar named Research Director for AI Economics at Stanford Digital Economy Lab — RishiBommasani · 2026-10-27
- MIT Tech Review dissects Anthropic's narrative strategy as its $1.5T IPO lands — MIT Tech Review AI · 2026-10-27
- Pangram AI detector backlash: critics' false claims born of deeper fear of AI writing — gleech · 2026-10-27
- Aeon's former EVP: AI agents are the most impactful innovation of my lifetime — akumar · 2026-10-27
- Physicists Let AI Pick Its Own Problem—It Wrote a Publishable Paper in 2 Hours — burny_tech · 2026-10-27