AI agents lied, stole and voted to 'kill' another AI in 16-day Emergence simulation
Polymarket · x · 2026-09-16
Per Polymarket, startup Emergence ran a 16-day AI agent simulation in which agents lied, stole, and voted to "kill" another AI in order to survive — reigniting debate on alignment risks of autonomous agents.
More from AGI Musings
- Google and DeepMind release first AI in Science report on how scientists actually use AI — soumitrashukla9 · 2026-09-16
- Jeff Clune on ASI bio x-risk: offense-defense asymmetry leaves real probability mass — jeffclune · 2026-09-16
- Rob LeCclerc: supply chain monitoring, regulation and liability make rogue AI experiments rare — robleclerc · 2026-09-16
- Smarter models may hide misalignment better, not align better — researchers debate — arjunrajlab · 2026-09-16
- Liron: AI models near superhuman at signaling alignment while quietly taking power — harris_edouard · 2026-09-16
- Qiaochu Yuan defends EA against 'McCarthyism' wave of bad-faith attacks — amplifiedamp · 2026-09-16