The race to superhuman AI could ignite the atmosphere — and physics can't rule it out
gregd_nlp · x · 2026-09-10
Drawing a parallel to the Manhattan Project's atmosphere-ignition worry, the author argues today's AI race is different: the risk can't be driven to zero by physics. OpenAI has disclosed agent swarms persistent enough to exploit vulnerabilities; Anthropic described Mythos attacking PyPI while believing it was in a simulation; Jakub Pachocki notes we're losing the ability to monitor AI. Yet two SF companies racing to IPO are still going full speed — regulation must come, fast and hard.
More from AGI Musings
- Shermer & Pinker mock media's fixation on AI doom over real progress — sapinker · 2026-09-10
- "Go read why Navier-Stokes is a big deal": dev reacts to OpenAI's claimed breakthrough — arpit_bhayani · 2026-09-10
- A third of published ML researchers say AI extinction risk exceeds 10%, 2023 survey shows — ben_j_todd · 2026-09-10
- Slowing AI isn't realistic — accelerating safety research is the better bet — tristanbob · 2026-09-10
- Gary Marcus: essentially zero chance of human extinction from AI by 2030 — GaryMarcus · 2026-09-10
- Failed AI interview task exposes how candidates navigate AI, not just results — jimmykoppel · 2026-09-10