David Krueger: intentional scheming is a small slice of AI x-risk, control research overfocused
JacquesThibs · x · 2026-11-06
Cambridge professor David Krueger respects Marius Hobbhahn but is skeptical his explanation is the full story and doesn't think it deflates the result. He argues the AI safety community's focus on "scheming" underestimates systematic bad behavior not motivated by coherent goals — AI cognition may be more a "hot mess," and a better baseline is humans, who routinely behave in systematically bad ways unknowingly. The shared excerpt argues control research exclusively targets intentional deception in early transformatively-useful AI, a relatively small slice of AI x-risk probability mass, limiting its impact.
Related event: AI Safety Researchers Rethink Control Narrative and Automated Alignment(2 posts)→
More from AGI Musings
- Runway cofounder explores what happens when AI moves from generating video to simulating worlds — every · 2026-11-06
- US Census Bureau starts surveying whether employees use generative AI at work, every two weeks — robseamans · 2026-11-06
- People worry agents are non-deterministic as if their old software was more predictable — zanbrum · 2026-11-06
- Ex-OpenAI VP Brundage: AI 2027 Is Unrealistic — Things Will Move Faster — Miles_Brundage · 2026-11-06
- Redditor rails against 'zero-effort AI novel in hours' viral-get-rich fantasies — Recent-Day3062 · 2026-11-06
- Opinion: AI industry needs soft power — explain itself to the public like crypto did — RichardsonDx · 2026-11-06