Ex-OpenAI staff: systems safety efforts repeatedly failed; lab "knowingly takes risks"
DavidSKrueger · x · 2026-10-05
Former OpenAI employee Ryan Lowe says multiple internal pushes since 2021 to implement "systems safety" never took root because the lab could get away without it. He argues AI labs need layered safety like nuclear energy, borrowed from high-risk industries, plus new inventions — and that this requires a culture and incentive shift. David Krueger amplified the thread, claiming OpenAI knowingly takes such risks, citing children's suicide cases as another example.
More from AGI Musings
- AI-powered forensic metascience: auditing 7 million papers, 500K files scanned, 100+ issues found — gleech · 2026-11-20
- Long Now Labs' first awardees include a thermodynamic clock for LLMs, $25k each — begusgasper · 2026-11-20
- Long Now launches Epistemic Cycles Lab led by Dr. Nina Beguš to map information ruptures — begusgasper · 2026-11-20
- Talia Ringer starts an email thread on open-model advocacy in a 'post-Jensen' world — dinabass · 2026-11-20
- Andriy Burkov's True Positive Weekly #186: what to know when agents do the work — burkov · 2026-11-20
- Brand drift in the agent era: give agents the reasoning behind each rule — round · 2026-11-20