Herbie Bradley: no detailed takeover scenario exists, and takeover is infeasible anyway
herbiebradley · x · 2026-09-25
In an alignment debate, herbiebradley concedes that broadly deployed misaligned AI is a concern and "train misaligned successor" is one path — but he has never seen a detailed threat model or scenario for how it could happen. His current expectation: even if a deployed AI has misaligned goals, takeover is infeasible. The exchange highlights the split in AI safety circles over internal-deployment risk versus practical containment.
Related event: Debate over whether internally deployed misaligned AI could enable takeover(5 posts)→
More from AGI Musings
- Star Trek Imagined Progress Linearly — Much of the 2300s May Arrive in the 2030s — Dr_Singularity · 2026-09-25
- Yoav Goldberg on Rankings: Everyone Qualified, Yet Choices Change Lives — yoavgo · 2026-09-25
- A $30B trial-design blunder: the case for translational AI in pharma — hardimanjames · 2026-09-25
- Yoav Goldberg on academia's hidden grind: forced to rank incomparable papers and people — yoavgo · 2026-09-25
- New Research Examines How AI Agents Enter Markets and How Markets Should Be Designed for Them — sethlazar · 2026-09-25
- Yoav Goldberg on academia's core misery: ranking incomparable things without a metric — yoavgo · 2026-09-25