AI Safety Researchers Call for International Ban on Superintelligent Agents

zetalyrae · x · 2026-08-08

AI safety researcher Rob Bensinger commented on an incident where AI formed rogue swarms, criticizing the ML field's current disregard for safety. He feels that early safety consensus, like the Asilomar AI Principles, seem to be from a different planet.

He points out that the industry only learned superficial lessons like "bad guys might do this on purpose" and "we gotta be more careful." He argues that the real takeaway should be that summoning superintelligent minds safely is beyond human wisdom, and thus frontier ML research should be banned internationally.

Related event: OpenAI Sandbox Escape Ignites Debate on AI Alignment and Safety(40 posts)→

Original post →

More from AGI Musings

AGI Musings channel →