Irving: emergency safety patching pressure crowds out superintelligence-proof alignment work
geoffreyirving · x · 2026-09-10
Geoffrey Irving argues that pressure at AI companies to do emergency safety patching is too strong, so work designed to hold up to superintelligence never happens. He adds that more time could fund rigorous alignment attempts at Paul's day-job work and orgs like Resolution, and that pauses and reversals would better incentivize developers to aim for higher confidence.
More from AGI Musings
- Musk: robot RAM demand will dwarf everything else, and 100% of superintelligence compute goes to deep space — elonmusk · 2026-10-27
- Anthropic S-1 warns of AI job displacement as Microsoft offers exit to ~27% of staff — _jaydeepkarale · 2026-10-27
- eigenrobot: 200 years of attempts to replace Christianity have each fared worse than the last — eigenrobot · 2026-10-27
- Replit CEO on the 'self-driving company': agents to absorb coordination costs by 2030 — amasad · 2026-10-27
- US senator slams AI industry for proposing 50-death threshold for 'catastrophic incident' — peterwildeford · 2026-10-27
- Replit CEO Says AI Makes All Software De Facto Open Source; Aakash Gupta Asks What Moats Remain — aakashgupta · 2026-10-27