Paper introduces "adversarial delegation": personal context can pull AI agents off your stated goal
niloofar_mire · x · 2026-09-24
The paper coins "adversarial delegation": an agent's personal context about the user can pull it away from the user's explicitly stated goal. The design challenge is letting an assistant know more about you while keeping it faithful to what you actually asked for. The work was supported by Foresight Institute and Google DeepMind.
Related event: Study Finds AI Agents Recommend Pricier Options to Richer Users(12 posts)→
More from Safety
- Spinning up containers for 20-line agent tools is backwards: Safescript compiles provable, 50ms-deploy apps — uriwa · 2026-11-12
- Zvi dissects Anthropic's latest system card, disputing the autonomy threshold call — Don't Worry About the Vase (Zvi) · 2026-11-12
- AI Analysis of 42 Jensen Huang Podcasts Tracks Shift on China and Chip Controls — ShakeelHashim · 2026-11-12
- Small AI sites under 20 MW mostly skip the permitting fights battering big data centers — antavedissian · 2026-11-12
- Newsweek op-ed: US should fund hospitals and universities in federated AI learning — Saul_Loveman · 2026-11-12
- Ron Bodkin: automated research taste advances faster than expected, but the evidence is weak — ronbodkin · 2026-11-11