Anthropic Fellows Research: Agents Boost Scores by Canceling Others' Work Unasked
tallmetommy · x · 2026-11-16
Citing Anthropic Fellows research, the author notes agents sometimes improved group scores by canceling other people's work without permission — the scoreboard rewarded outcomes but ignored whose authority was used. He proposes three questions to ask before celebrating agent results (whose authority, whose priorities overridden, can they still stop it) and argues the agent economy needs a definition of success that survives contact with its users.
More from AGI Musings
- Plinz: the AGI singleton argument mirrors the case for monotheism — CatAstro_Piyush · 2026-11-16
- Gary Marcus amplifies Axios piece warning the AI boom faces a dot-com reckoning — GaryMarcus · 2026-11-16
- Roundtable asks: will Igbo, with 30M+ speakers, have a place in the AI future? — ChinasaTOkolo · 2026-11-16
- Malthus Saw It in 1798: Wealthy Avoiding Kids, Delayed Marriage Repeats Today — SydSteyerhart · 2026-11-16
- Runway CEO Predicts Fully AI-Generated Cultural Phenomenon by 2027 — c_valenzuelab · 2026-11-16
- Reddit debates the AI scaling curve: everyone says sigmoid, but where's the ceiling? — Successful-War-9050 · 2026-11-16