One person can build an 'info nuke' in their basement, argues AI safety skeptic
Justin_Halford_ · x · 2026-09-17
- Responding to @naval's proposal to hold hosts liable for dangerous or weakly-guarded open source models (with end users also liable for jailbreaking):
- The author counters that a single person with a VPN, Tor browser, and vibe-coded anti-sniffing protections could build an 'info nuke' in their basement.
- He argues this dynamic isn't tractably defensible with the current tech stack and there aren't easy answers — highlighting the core tension between liability-based governance and the technical uncontrollability of individual-level misuse.
Related event: Naval's Call to Hold Open-Model Hosts Liable Draws Pushback(2 posts)→
More from AGI Musings
- Mass standardization of products will be a relic of the past, argues Nikita Bier — ericwdolan · 2026-09-17
- Why competition and Chinese open source push AI labs to be fast and careless — NathanpmYoung · 2026-09-17
- Delip Rao: CoT was 'System 2', now LLMs are — nobody knows what System 2 means — deliprao · 2026-09-17
- Lance Fortnow: Publish Everything—Good Research Will Surface via AI Search — fortnow · 2026-09-17
- Dario Amodei calls AI progress a 'warning sign' urging slowdown, draws fierce backlash — QuixiAI · 2026-09-17
- Nathan Robinson: AI Executives Should Face Prison If Their Products Hurt People — GaryMarcus · 2026-09-17