Andrew Critch: I've said since 2016 AI slowdown fits industry incentives — why the surprise?
AndrewCritchPhD · x · 2026-09-13
Safety researcher Andrew Critch responds to Jeff Ladish's surprise that unilateral safety commitments and coordinated industry slowdown happened together, posing two pointed questions.
- Why didn't you see it coming? Critch says he has argued since 2016 that controlling AI well enough to prevent rogue behavior is highly aligned with business incentives, and this was expected once models reached math ability sufficient to automate research.
- How are you updating? He presses on Bayesian world-model revision: if this outcome surprised you, your priors about industry incentives were likely miscalibrated.
Related event: Amodei, Altman and Musk unite on slowing AI, sparking debate over motives(62 posts)→
More from AGI Musings
- Nat Lambert: Open models could be what holds the AI ecosystem together — natolambert · 2026-10-31
- Kai-Fu Lee's 'AI Native' ships Nov 3 with endorsement from Satya Nadella — kaifulee · 2026-10-31
- AI security's dark age: agents can probe every endpoint and attack surface — graceisford · 2026-10-31
- AI dinner takeaways: orgs shipping 5x faster, yet GDP isn't growing 30% a year — graceisford · 2026-10-31
- Companies that replaced engineers with AI are rehiring seniors at a premium — DavidLinthicum · 2026-10-31
- Nathan Young proposes prediction markets and AI reporting for AI-community accountability — NathanpmYoung · 2026-10-31