DeepMind's Geoffrey Irving: AI safety rigor sits at the bottom of a hierarchy of standards

geoffreyirving · x · 2026-10-24

DeepMind safety researcher Geoffrey Irving published a thread on the gap between AI labs' methods and more rigorous industries like aviation and nuclear power, laying out a hierarchy of safety levels by standard of rigor — from 'slapdash empirics' to 'unconditional proofs' — with the AI industry currently at the bottom.

Mathematician Jacob Tsimerman, amplifying it, argues the public should understand society can demand higher rigor: the riskiest technologies warrant the strictest standards, and intermediate rigor levels far better than today's are available.

Related event: Irving: Alignment May Need Cryptography-Grade Rigor as Labs Remain Stuck in Ad-Hoc Empiricism(6 posts)→

Original post →

More from AGI Musings

AGI Musings channel →