Security researcher: high p(doom) that won't update on bad cyber premises is low-status
nptacek · x · 2026-09-16
Security researcher nptacek criticized some in the AI safety world: people hold high p(doom) based on false cybersecurity premises, then refuse to update even when shown exactly where their reasoning fails. He argues that refusing to update is lower-status than the high p(doom) itself, highlighting the deep divide between cybersecurity practitioners and the AI safety community on interpreting loss-of-control incidents.
More from AGI Musings
- AI collapses three team roles into one, fueling the rise of super-individuals — dotey · 2026-09-16
- AI safety figure: pausing AI 'just a couple years' could buy decades more with loved ones — beffjezos · 2026-09-16
- Timothy Lee: Valley elites who excel at narrow tasks may misjudge AI doom scenarios — binarybits · 2026-09-16
- AI Finally Breaks Cyber Defense's Math: The Defender Can Buy Coverage Instead of Hiring It — r0ck3t23 · 2026-09-16
- Sanders calls out Musk's AI-doom U-turn: from 'summoning the demon' to calling warnings a 'setup' — Promptmethus · 2026-09-16
- NYT maps Silicon Valley and Washington's AI camps: slowdowners, accelerationists, and the middle — bradneuberg · 2026-09-16