New paper: AI agent risks evolve from agency to autonomy to control
rohanpaul_ai · x · 2026-08-20
Paper from Shanghai AI Lab and Tsinghua argues AI risks change category with cognitive expansion: from threatening human agency (physical cognition) to autonomy (social cognition) and finally control (self-referential cognition). Safety mechanisms must evolve alongside.
Related event: Shanghai AI Lab Paper Maps Cognition-Induced Risks in AI Agents(2 posts)→
More from Safety
- July's rogue agent incidents highlight need for prior third-party auditing — Miles_Brundage · 2026-08-20
- NSF launches CyberAI program, selecting 14 universities to train security workforce — keviv9 · 2026-08-20
- GLM-5.3 hits frontier range; Cerebras claims 30x GPU inference speed — 创业邦 · 2026-08-20
- Forbes reports on companies buying and destroying rare books to train AI — SubstantialPressure3 · 2026-08-20
- US lawmakers introduce 'AI Kill Switch Act' requiring human override for frontier systems — Miles_Brundage · 2026-08-20
- Experts criticize OpenAI safety strategy, call for independent oversight — andersonbcdefg · 2026-08-20