Commenter likens AI labs to arms industry with no safety incentives
gerardsans · x · 2026-09-14
Responding to a call for OpenAI and Anthropic to build better security teams, the poster argues AI labs resemble the arms industry: no incentive to make "weapons" safe, and every opportunity since 2023 squandered because fixes are costly. Harnesses have no safety, he claims—full access to everything in context means a simple search or skill can hijack a whole agent swarm like a 2022-era jailbreak.
Related event: Cryptographer Urges OpenAI and Anthropic to Beef Up Security(2 posts)→
More from AGI Musings
- Security researcher: vibe coding will force software to consolidate around mature products — jd_pressman · 2026-10-31
- AI pushes circuit lower bound from 3.1n to 3.5n as UCLA-backed challenge aims at P vs NP — soumitrashukla9 · 2026-10-31
- What is work for? Cross-national survey of 8,234 adults on meaning in the AI age — soumitrashukla9 · 2026-10-31
- Which universities win top students may hinge on healthy AI-use boundaries, argues researcher — brianryhuang · 2026-10-31
- Researchers debate whether more inference compute can substitute for training compute — teortaxesTex · 2026-10-31
- Five agents can agree because they made the same mistake, krishnan warns with satire — krishnan · 2026-10-31