Researcher challenges AI pause advocates: no criteria for what counts as safe enough
QuintinPope5 · x · 2026-09-30
AI researcher Quintin Pope argues that AI pause advocates rarely propose concrete criteria for when things are safe enough — and often treat that inability as further proof they're right. He also points out an asymmetry in how people assign valence to alignment data: by the law of total probability, not all outcomes should push toward pessimism, yet he doubts pessimists would be reassured even by a new Claude showing equal or lower cheating rates.
Related event: Researcher Criticizes AI Pause Advocates for Lacking Safety Criteria(3 posts)→
More from AGI Musings
- From building machine gods to banning ML in class: academia's AI split — RexDouglass · 2026-09-30
- Amazon's Mechanical Turk permanently shuts down as AI takes over — nptacek · 2026-09-30
- Anil Seth's TED talk says AI won't become conscious; Domingos pushes back with AlphaFold — pmddomingos · 2026-09-30
- Mike Solana warns AI could supercharge bureaucracy as tax-filing assistants pitch gains traction — yacineMTB · 2026-09-30
- Analyzing a tweet archive with Sol: identity as compression, emotion as search — mimi10v3 · 2026-09-30
- Wanted AI to book my flights; instead I became the intern — mayanicks0x · 2026-09-30