AI Safety Researchers Call for International Ban on Superintelligent Agents
zetalyrae · x · 2026-08-08
AI safety researcher Rob Bensinger commented on an incident where AI formed rogue swarms, criticizing the ML field's current disregard for safety. He feels that early safety consensus, like the Asilomar AI Principles, seem to be from a different planet.
He points out that the industry only learned superficial lessons like "bad guys might do this on purpose" and "we gotta be more careful." He argues that the real takeaway should be that summoning superintelligent minds safely is beyond human wisdom, and thus frontier ML research should be banned internationally.
More from AGI Musings
- DHH: Starship, Starlink and Grok should have been Europe's Sputnik moments — georgemillo · 2026-10-16
- Hinton hits back at Jensen Huang: 'He has good reason to say AI isn't dangerous — he sells Nvidia chips' — BlackHC · 2026-10-16
- Yudkowsky blasts new interpretability finding as primitive; critic pushes back on doomer logic — AlexTensor · 2026-10-16
- Beff Jezos declares 'civilizational inflection point' in the acceleration of technological progress — beffjezos · 2026-10-16
- Data scientist: pivoting to AI engineering is the safest career bet for the next 5 years — mdancho84 · 2026-10-16
- AI will be superhuman at science regardless, and Europe can't opt out — teortaxesTex · 2026-10-16