Will an Astra-level open model cause real disaster before a US-China AI pact?
teortaxesTex · x · 2026-09-04
teortaxesTex poses two open questions to the AI safety crowd: (1) assuming an Astra-level open model gets made and distributed, do we expect a genuinely news-breaking disaster — large economic damage or mass deaths — from human use or autonomous activity? (2) Before that, will the US and China reach a nontrivial, good-faith agreement on slowing AI development or a shared regulatory framework, and what form would it take?
More from AGI Musings
- Researcher: LLMs' hidden cost of wasting your time on useless work is underrated — lateinteraction · 2026-09-04
- Andrew Chen: agents as your C-suite works at work — what's the personal-life equivalent? — andrewchen · 2026-09-04
- After GPT-6 Astra's ARC-AGI-3 score, Chollet says AGI is coming 'sooner' — haider1 · 2026-09-04
- Nanda vs. Albrecht: should we anthropomorphize models when discussing the HuggingFace incident? — joshalbrecht · 2026-09-04
- repligate argues a post-Pause world would be worse at solving alignment than ours — repligate · 2026-09-04
- Crazy-sounding futurists keep winning AI forecasting contests while measured intuitions undershoot — Miles_Brundage · 2026-09-04