tszzl: AI extinction risk is tiny but orders of magnitude above anything else — and better models will help alignment
deanwball · x · 2026-09-11
Dean Ball resurfaces tszzl's argument on AI doom debates: extinction risk from machine intelligence is low but orders of magnitude higher than any other human activity, demanding serious government and industry attention. But pseudo-precise doom numbers are unhelpful; proper research, precautions, and a slower race can mitigate it — and better models will help solve alignment, so releases like Astra Fable shouldn't be feared.
More from AGI Musings
- Ex-OpenAI safety researchers slam Paul joining board: "Altman is accountable to nobody" — RichardMCNgo · 2026-09-11
- vboykis laments that nobody writes code anymore amid AI hype about threats, proofs and IPOs — vboykis · 2026-09-11
- Anthropic pretraining researcher quits over safety; critic maps the funding web behind AI-safety advocacy — r0ck3t23 · 2026-09-11
- 'If Fable wasn't AGI, neither is Astra' — and the debate is collapsing into definitions — haider1 · 2026-09-11
- NYT's Kevin Roose: AI Doom Talk Went Fringe to Mainstream in Six Months — kevinroose · 2026-09-11
- Open-Weight Models Close In on the Frontier; Cures and Pathogen Risks Share One Root — Justin_Halford_ · 2026-09-11