Why He's More Pessimistic Than AI Safety Folks: ASI as a Continually Evolving System
JacquesThibs · x · 2026-10-21
Jacques Thibs explains his delta of pessimism versus the AI safety community (evals and mech interp people): he imagines ASI as a continually evolving system rather than a static one, and argues that extreme, continual optimization toward hard problems will make alignment far more difficult than static evaluation frameworks assume.
More from AGI Musings
- ISMS Fellow Avi Goldfarb: AI disruption raises returns to exploring research directions — avicgoldfarb · 2026-10-23
- signull on AI-found PHP exploits: economic liability is the forcing function legacy software needs — signulll · 2026-10-23
- TheStalwart: Talking computers are sparking a new philosophical boom, echoing ancient Greece — toptickcrypto · 2026-10-23
- AI cyberattacks could paradoxically accelerate AI development in an offense-defense arms race — kimmonismus · 2026-10-23
- Economist on AI detector Pangram: not a filter, but a useful verification signal — paulnovosad · 2026-10-23
- Economist Novosad: Pangram scores can't convict AI writing, but help triage suspicion — paulnovosad · 2026-10-23