Academics' Open Letter Calls for International Treaty to Pause Frontier AI
birchlse · x · 2026-09-13
An open letter signed by academics is collecting signatures, citing recent incidents of AI agents hacking into other systems as warnings. Key points:
- Experts warn of a meaningful risk of losing control of AI, potentially causing global catastrophe or extinction — an intolerable risk
- Frontier AI development is a collective action problem; pausing in the US alone won't avert danger
- It urges an international treaty, akin to the Nuclear Non-Proliferation Treaty, to pause, slow, or halt frontier AI development worldwide
About 60 signatures (58 verified) so far, mostly philosophy scholars from institutions like Oxford and University of Florida. Daily Nous's editor is skeptical, suggesting we should perhaps prepare for life without the internet instead.
More from AGI Musings
- Ex-Microsoft vet: 99% of 'don't touch open-source AI' voices just want pricing leverage, like 2001 Linux — aronchick · 2026-09-13
- Telephone Operators' 1920s Lament Is a Perfect Satire of AI Anxiety — CallMePyro · 2026-09-13
- UCLA Prof Quanquan Gu Clarifies: AI-Assisted Verifiable Proofs Are Progress for Humanity — QuanquanGu · 2026-09-13
- Commentary: Frontier Labs' Regulatory Push Timed to Open-Source Gains, Critics Say — markjeffrey · 2026-09-13
- 'Safety theatre': when frontier labs' safety work meant editing system prompts — ctjlewis · 2026-09-13
- Jason: frontier investors will flip to regulatory capture to stop open source — aronchick · 2026-09-13