Warning: AI Could Design a Novel Virus Right on the First Try, Asymmetrically Helping Bad Actors
_onionesque · x · 2026-09-14
A widely shared warning on AI biosecurity: AI that has designed zero effective things in the real world could design a novel virus and get it right on the first try. The author argues this capability asymmetrically accrues to bad actors, who casually have eight-figure labs, and the resulting harm would be not just large but total — a core frontier-model bio-risk concern in AI safety debates.
Related event: Debate Rages Over Whether AI Could Design a Deadly Virus(2 posts)→
More from AGI Musings
- Is Big Tech's AI slowdown a safety pact or a cartel? The Verge examines — haydenfield · 2026-09-15
- How labs would actually "pace the frontier": more compute on alignment at lower margins — AccBalanced · 2026-09-15
- Parent says teen daughter shouldn't study calculus, sparking AI-education debate — PAstynome · 2026-09-15
- Noam's 2-year-old bet that general models would beat humans on a benchmark pays off — GregKamradt · 2026-09-15
- 'People Who Say We Need to Nuke SF Are More Hypocritical Than OpenAI' — wordgrammer · 2026-09-15
- e/acc's Beff Jezos Argues Capability Diffusion Is Safest, Slams Anthropic's Closed Approach — beffjezos · 2026-09-15