Nathan Lambert: The Open-Model Cyber Risk Debate Is Broken and Leading to Lose-Lose Policy
natolambert · x · 2026-10-06
Nathan Lambert argues the discourse on open-weight models' cyber risks ignores evidence of closed-model risk and devolves into fear-mongering, especially regarding China, despite Mythos-class cyber-capable models shipping largely without incident. He maps three camps — frontier labs and the US national security community seeing open weights as untenable risk; moderates (himself, Hugging Face, Joshua Saxe) arguing open weights are needed for defense; and Chinese companies releasing capable open models per their own risk assessments — and warns current trajectories risk both US competitiveness and long-term cyber safety.
Related event: Nathan Lambert Says Cyber Risk Discourse on Open Models Is Broken(2 posts)→
More from AGI Musings
- Calling a text sampler a superintelligence will end badly: OOD cliffs and the hype gap — gerardsans · 2026-10-06
- John Langford's COLM 2026 Keynote 'Research at AI Speed' Examines the Industrialization of R&D — JohnCLangford · 2026-10-06
- Nearly 4 years of ChatGPT: zero direct AI deaths vs 225M from disease and aging — DeryaTR_ · 2026-10-06
- 2048 Satire: Every Job Automated Except Healthcare Admin and Unionized Work — rickasaurus · 2026-10-06
- MIT economist: even the most optimistic AI scenario means major labor disruption — soumitrashukla9 · 2026-10-06
- Ethan Mollick: surprisingly few terrible AI incidents across a billion users — emollick · 2026-10-06