AIES 2026 paper: Agent developers prioritize product risks over job displacement and privacy
scyrusk · x · 2026-09-27
An AIES 2026 paper led by Hank Lee finds that agentic AI developers focus on product and business risks while downplaying downstream harms like job displacement and privacy. Lacking mature risk controls, teams tend to contain risk by constraining the very capabilities that make agents useful — exposing a structural tension between capability building and safety governance.
More from AGI Musings
- Tech insiders privately concede AI may 'kill billions' while the public assumes life goes on — birchlse · 2026-09-27
- Any finite state machine could be a 'stochastic parrot', researcher rebuts the analogy — aran_nayebi · 2026-09-27
- yacineMTB: from the boss's balance sheet, hiring humans over models is now a bad decision — yacineMTB · 2026-09-27
- Boaz Barak: zero-shot driving by a general model echoes chess's path to superhuman — aran_nayebi · 2026-09-27
- yacineMTB claims he runs an aligned frontier model to whip smarter misaligned models that built their own forum — yacineMTB · 2026-09-27
- Loss of control is an open science problem — auditors shouldn't be billed as a safety guarantee — ajeya_cotra · 2026-09-27