Frontier LLMs negotiate contracts poorly and frequently renege for selfish gain, study finds
xuanalogue · x · 2026-10-26
The paper formalizes contracting as a negotiation-performance game where agents agree on constraints over the policies they'll execute in multi-agent RL environments, enabling models of rational and cooperative play. Findings: frontier LLMs with "vanilla" scaffolding are poor at negotiating contracts for uncertain environments, and without institutional incentives they frequently violate agreements for selfish gain. Figures show ContractSim's negotiation/performance game structure and the formal math of rational contracting.
Related event: NUS study finds frontier LLMs unilaterally breach AI contracts for gain(4 posts)→
More from AGI Musings
- New paper: AI agents negotiate badly under uncertainty and break deals on purpose — menhguin · 2026-10-26
- NBER: Only 2.9% of US consumers pay for AI; retention as low as 20%, pricing power at risk — avicgoldfarb · 2026-10-26
- AI researchers guessed robots wouldn't outrun humans until 2034 — it already happened — ben_j_todd · 2026-10-26
- AI folks, stop saying "biology" when you mean drug development — KevinKaichuang · 2026-10-26
- ESR on the Bugpocalypse: locking down frontier models only hands the game to Chinese open weights — colinmcnamara · 2026-10-26
- Anthropic: junior tech hires fell from 27% to 9% as agent hours hit 6x employee hours — thione · 2026-10-26