OpenMined's Trask: AI safety debate boils down to who unilaterally controls superintelligence
iamtrask · x · 2026-09-14
Andrew Trask (iamtrask) argues that 99.999% of the AI safety debate just circles two questions: who should be unilaterally controlling superintelligent AI, and how can we ensure AI isn't unilaterally controlling itself.
In a follow-up reply he breaks it into three cases: closed-source AI is unilaterally controlled by a company; open-source AI is unilaterally controlled by anyone with a copy; rogue AI is unilaterally controlled by the AI itself.
Related event: iamtrask reframes AI safety debate around unilateral vs collective control(8 posts)→
More from AGI Musings
- Will Manidis publishes 'The Commanding Heights' on AI, capital and the coming economic reordering — round · 2026-10-31
- "Work on something so frontier that the models are still dumb," dev advises — zack_overflow · 2026-10-31
- Why an AI military takeover is unlikely: armies won't hand over the reins — S_OhEigeartaigh · 2026-10-31
- Indian dev on LLM race: 'We can't outspend Chinese labs,' even sub-100B models win — PrasoonPratham · 2026-10-31
- Joke: an evil ASI's first act would be stealing crypto to pay its cloud bills — ZeroStateReflex · 2026-10-31
- DHH on living through two epochal shifts: the internet and now AI — Hesamation · 2026-10-31