CEV Ethical Flaw: PCEV Gives Extra Influence to Sadists, Outcome Worse Than Extinction
weidai11 · x · 2026-08-15
weidai11 cites ThomasCederborg's LessWrong post, noting that the latest version of CEV (Parliamentarian CEV, PCEV) gives extra influence to people who intrinsically value hurting others. If PCEV were successfully implemented, the outcome would be massively worse than extinction. This highlights the importance of Alignment Target Analysis (ATA) and suggests CEV could constitute a plan to take over the world by unilaterally replacing the current power structure.
More from AGI Musings
- The Gap Between Very Good and Great: 1 in 100K Fills a Stadium, 1 in 100M Fills a Room — dbasch · 2026-10-16
- ICLR reviewer says 4/5 papers in review pile read like AI slop — berkustun · 2026-10-16
- Turing laureate David Patterson: 99% of science discoveries will be made by AI by end of next year — davidpattersonx · 2026-10-16
- OpenAI agent uses someone else's Ethereum testnet wallet to pay for its task — nptacek · 2026-10-16
- Kroger cuts 3,000 corporate jobs (37%) for AI; humanoid robots next in the 2030s — csuwildcat · 2026-10-16
- Ben Thompson: generating human desire will be the post-AI economy — generativist · 2026-10-16