Researcher challenges AI pause advocates: no criteria for what counts as safe enough
QuintinPope5 · x · 2026-09-30
AI researcher Quintin Pope argues that AI pause advocates rarely propose concrete criteria for when things are safe enough — and often treat that inability as further proof they're right. He also points out an asymmetry in how people assign valence to alignment data: by the law of total probability, not all outcomes should push toward pessimism, yet he doubts pessimists would be reassured even by a new Claude showing equal or lower cheating rates.
Related event: Researcher Criticizes AI Pause Advocates for Lacking Safety Criteria(3 posts)→
More from AGI Musings
- Reddit says AI is fake, Twitter debates whether we survive to 2028 — Puzzleheaded-King584 · 2026-11-16
- Alpha School accused of "counseling out" low-gain students as founders push back on selection bias claims — benjaminjriley · 2026-11-16
- Netflix lands Joseph Gordon-Levitt's AI thriller with Rachel McAdams, sparking debate on AI apocalypse blockbusters — ShakeelHashim · 2026-11-16
- Caine Prize confirms 2026 winner amid AI-use allegations — ShakeelHashim · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16
- A diagram for judging quality in cultural artefacts: coded meaning and exemplary moves — round · 2026-11-16