UCSD paper bakes theory of mind into RL reward, letting a 7B agent model partners solo

rohanpaul_ai · x · 2026-10-12

A UC San Diego paper, "Mental-Models for Multi-Agent Systems" (arXiv:2610.12453), introduces mental-model-enabled agents: an inferred model of a partner's beliefs, intents and goals — including second-order beliefs about the agent itself — scores candidate replies during RL via an amortized recursive Theory-of-Mind representation. The trained policy runs standalone at inference without carrying the partner model, yet retains explicit partner modeling. Across negotiation, cooperation, competition and assistance settings in both language and multimodal benchmarks, explicit mental-state modeling consistently improves interaction quality and ToM performance over prompt- and memory-based baselines.

Original post →

More from coding & agent

coding & agent channel →