Physicist's case: AI risk jumps orders of magnitude because information has no mass
AryHHAry · x · 2026-09-15
A theory-physics-trained author argues AI risk isn't a new kind of danger, but its intensity jumps orders of magnitude due to scale. Every previous dangerous technology had a physical bottleneck as a universal speed bump — nuclear weapons need expensive, visible uranium enrichment; bioterrorism needs BSL labs; chemical weapons need supply chains. Information, however, has no mass: the same model weights can be copied to a million GPUs within hours, and capability isn't conserved.
The post cites an open letter reportedly signed by OpenAI, Anthropic, Microsoft, AWS and 100+ companies stating organizations have only months to prepare for AI-driven swarm cyberattacks targeting hospitals, water treatment and infrastructure. It also mentions researcher Jacob Coxon's resignation from Anthropic, quoting that the people building AI are "genuinely convinced it could kill us all before the end of this decade," while executives deliberately soften the language in media.
More from AGI Musings
- Stanford papers blueprint how humans can stay in charge of autonomous AI agents — alex_verem · 2026-09-15
- AI web research reconstructs lost history of a demolished building from scattered archives — flowersslop · 2026-09-15
- "AI alignment is a harmful meme": a provocative take gaining consensus — mayfer · 2026-09-15
- AI-pessimism satire: 'scheduled retweet for 2056' mocks endless doom predictions — inductionheads · 2026-09-15
- Lapis hits second $1M revenue month, founder shares enterprise AI sales lessons — aarthir · 2026-09-15
- Thought experiment: benevolent ASI seizes totalitarian control by 2040 — good or bad outcome? — corbtt · 2026-09-15