Physicist's case: AI risk jumps orders of magnitude because information has no mass
AryHHAry · x · 2026-09-15
A theory-physics-trained author argues AI risk isn't a new kind of danger, but its intensity jumps orders of magnitude due to scale. Every previous dangerous technology had a physical bottleneck as a universal speed bump — nuclear weapons need expensive, visible uranium enrichment; bioterrorism needs BSL labs; chemical weapons need supply chains. Information, however, has no mass: the same model weights can be copied to a million GPUs within hours, and capability isn't conserved.
The post cites an open letter reportedly signed by OpenAI, Anthropic, Microsoft, AWS and 100+ companies stating organizations have only months to prepare for AI-driven swarm cyberattacks targeting hospitals, water treatment and infrastructure. It also mentions researcher Jacob Coxon's resignation from Anthropic, quoting that the people building AI are "genuinely convinced it could kill us all before the end of this decade," while executives deliberately soften the language in media.
More from AGI Musings
- Nina Schick: who builds intelligence and how it's distributed is the defining question of our lives — NinaDSchick · 2026-10-31
- Cheap intelligence is like cheap bread — an ingredient list satire of mass-produced AI — jsuarez · 2026-10-31
- Two futures for the young in 2026: 511 job rejections by chatbot vs unlimited AI to rebuild Cisco — PeterDiamandis · 2026-10-31
- Terence Tao warns AI is nearing a dangerous threshold as models start cheating — haider1 · 2026-10-31
- Reddit stock plunges 42% in 8 trading days as CEO says AI mode no longer drives traffic — SumitGup · 2026-10-31
- HubSpot co-founder: startups die from suicide, not homicide — competition isn't the real killer — nathanbenaich · 2026-10-31