Penn's Aaron Roth gives exact LP-duality condition for when reviewer-agent approval keeps a system provably safe
Aaroth · x · 2026-09-15
Aaron Roth poses the question: if the driver agent is untrusted, why trust the reviewer agent whose utilities differ from yours? He derives a remarkably clean characterization in a one-decision model: the system is safe — meaning principal utility is guaranteed no worse than the baseline policy — if and only if the principal's utility lies in the non-negative span of the reviewers' utilities. The forward direction is elementary; the converse follows from LP duality. The result turns intuition about auto-approve features into a mathematically decidable condition.
More from Safety
- Cryptographers push back: claims ECC is likely to break are not consensus — jedisct1 · 2026-11-02
- UK's 'AI sovereignty' push undermined by its own energy and copyright policy — NinaDSchick · 2026-11-02
- Auditing my MCP credential broker: the worst hole was the config file — Relevant_Mousse_9117 · 2026-11-02
- Cambricon co-founder urges shared US-China AI ethics standards for leading models — pstAsiatech · 2026-11-02
- Vitalik's "post-AI cryptography": pseudonyms are dead, per-action anonymity is in — devanshmehta · 2026-11-02
- 6 prompts to see what ChatGPT quietly knows about you — and wipe it — Aiden_Tech_Ai · 2026-11-02