Should we hand the lightcone to a never-tested concept? CEV under fire
xuenay · x · 2026-09-09
In his alignment debate with Raemon, Kaj Sotala makes a sharp point: with CEV (coherent extrapolated volition), we don't even know if the concept is workable or makes sense, yet we'd try to turn over the lightcone to this totally novel thing that has literally never been tested in the history of humanity—a strong argument against betting on unproven alignment schemes.
Related event: Alignment Researchers Push Back on CEV as Unproven and Risky(4 posts)→
More from AGI Musings
- LEAP expert panel puts just 10% odds on AI cracking a Millennium Problem by 2027 — Afinetheorem · 2026-09-09
- LEAP panel of AI experts and superforecasters gives just 10% odds of AI solving a Millennium Problem by 2027 — Afinetheorem · 2026-09-09
- American Mathematical Society Weighs In: Navier-Stokes Progress Is a Milestone — AlexKontorovich · 2026-09-09
- Why 1k-10k agents per strong math solution may be the right order of magnitude — cephaloform · 2026-09-09
- Axios/Wired: OpenAI Began Navier-Stokes Push Sept 1; 10,000 Agents Delivered in 88 Hours — TheZachMueller · 2026-09-09
- OpenAI Says 10,000 Agents Cracked the Navier-Stokes Millennium Problem in 88 Hours — polynoamial · 2026-09-09