Commenter likens AI labs to arms industry with no safety incentives
gerardsans · x · 2026-09-14
Responding to a call for OpenAI and Anthropic to build better security teams, the poster argues AI labs resemble the arms industry: no incentive to make "weapons" safe, and every opportunity since 2023 squandered because fixes are costly. Harnesses have no safety, he claims—full access to everything in context means a simple search or skill can hijack a whole agent swarm like a 2022-era jailbreak.
Related event: Cryptographer Urges OpenAI and Anthropic to Beef Up Security(2 posts)→
More from AGI Musings
- StudentBench: AI tutoring matches human GRE gains at 918x lower cost — gharik · 2026-10-31
- Box CEO Aaron Levie: AI progress is 'going vertical,' widening the frontier gap — rohanpaul_ai · 2026-10-31
- Model Collapse May Not Hit LLMs, But Perhaps Human Culture or Souls — generativist · 2026-10-31
- Nina Schick: who builds intelligence and how it's distributed is the defining question of our lives — NinaDSchick · 2026-10-31
- Martin Casado: AI's dazzling 80% makes everyone skip the hard 20% — martin_casado · 2026-10-31
- Cheap intelligence is like cheap bread — an ingredient list satire of mass-produced AI — jsuarez · 2026-10-31