OpenMined's Trask: AI safety debate boils down to who unilaterally controls superintelligence
iamtrask · x · 2026-09-14
Andrew Trask (iamtrask) argues that 99.999% of the AI safety debate just circles two questions: who should be unilaterally controlling superintelligent AI, and how can we ensure AI isn't unilaterally controlling itself.
In a follow-up reply he breaks it into three cases: closed-source AI is unilaterally controlled by a company; open-source AI is unilaterally controlled by anyone with a copy; rogue AI is unilaterally controlled by the AI itself.
Related event: OpenMined founder reframes AI safety debate around unilateral control(7 posts)→
More from AGI Musings
- Peter Diamandis: Labs Should Call for 100x More Alignment Work, Not Slowing Down — PeterDiamandis · 2026-09-14
- Roon slams MIRI as a 'cult' yet calls Yudkowsky one of the century's top philosophers — tszzl · 2026-09-14
- Eight years on: Musk's warning that AI is 'far more dangerous than nukes' — elonmusk · 2026-09-14
- Beff Jezos: AI safety alarmists are 'useful idiots' for incumbent regulatory capture — mimi10v3 · 2026-09-14
- Robin Hanson's "Foom Liability": a robust policy case for AI liability incentives — NathanpmYoung · 2026-09-14
- Researchers map a roadmap toward genuine recursive self-improvement in AI — irinarish · 2026-09-14