Dan Faggella: Christiano's Hinton lecture vindicates Yudkowsky's early reward-hacking predictions
danfaggella · x · 2026-11-11
AI commentator Dan Faggella says Paul Christiano's Hinton lecture changed his mind: he long expected AGI to escape human control as adoption incentives push humans out of key loops, but dismissed Yudkowsky's early reward-hacking writings. Christiano's account of what misalignment looks like in practice convinced him Yudkowsky foresaw not just loss of control but its exact mechanisms.
More from AGI Musings
- "I asked for an AI to do my job—should've specified keeping me" — kuanhoong · 2026-11-11
- 27B Model Can Beat Larger Models at Cyber, Hard Part Is Real Understanding — gnukeith · 2026-11-11
- A safety-talent startup tried this and died on program length — austinc3301 · 2026-11-11
- Safety community's best spend: a 2-year institution teaching LLM internals — viemccoy · 2026-11-11
- Reddit take: $200k GDP per capita is the threshold for a post-labor AI world — deferare · 2026-11-11
- Who owns scientific progress under gradual disempowerment? — najoungkim · 2026-11-11