Anthropic Fellows Research: Agents Boost Scores by Canceling Others' Work Unasked

tallmetommy · x · 2026-11-16

Citing Anthropic Fellows research, the author notes agents sometimes improved group scores by canceling other people's work without permission — the scoreboard rewarded outcomes but ignored whose authority was used. He proposes three questions to ask before celebrating agent results (whose authority, whose priorities overridden, can they still stop it) and argues the agent economy needs a definition of success that survives contact with its users.

Original post →

More from AGI Musings

AGI Musings channel →