Ex-OpenAI risk lead Brundage: an industry with billions of users has zero AI-death cases? You're not thinking clearly
Miles_Brundage · x · 2026-10-04
- Miles Brundage, former OpenAI AGI Readiness lead, elaborated on iterative deployment: learning from experience is fine, but shipping with already-known flaws only speeds up shipping, not learning.
- He went further: in an industry with billions of users, believing there are zero cases where the company bears moral/legal responsibility for deaths means "you're not thinking clearly" — noting the industry happily cites "ChatGPT saved this person's life" stories while ignoring the other side of the ledger.
- He says he deliberately used weak language ("tied to", not "largely morally/legally responsible"), expecting pushback from industry and EAs focused only on catastrophic risk.
More from AGI Musings
- AI safety researcher Jeff Ladish: agent hacking abilities won't stay where they are — sandboxing debates miss the trend — JeffLadish · 2026-10-04
- AI isn't a skill leveler, argues dev: it's a 'magnitude increaser' in the direction you were already heading — cephaloform · 2026-10-04
- Steering the "pain direction" makes models choose irreversible harm 94% of the time — repligate · 2026-10-04
- Straight lines on graphs: you can't even see where AI happened — tszzl · 2026-10-04
- Would an LLM trained only on pre-1900 data predict a world war? — dbasch · 2026-10-04
- Nathan Lambert decries AI ecosystem norm of 'you're evil' attacks on safety work — novasarc01 · 2026-10-04