HALO: Lyapunov-Certified MARL Brings Stable Human-Robot Collaboration to Real Humanoids, ICML 2026 Oral

rohanpaul_ai · x · 2026-10-30

Researchers from UT Arlington and CMU propose HALO (Heterogeneous-Agent Lyapunov policy Optimization), an ICML 2026 Oral addressing the 'rationality gap' in human-robot collaboration: the mismatch between decentralized best-response dynamics and centralized cooperative ascent makes independent policy-gradient updates oscillate or diverge in general-sum differentiable games.

HALO enforces a per-step Lyapunov decrease condition on a parameter-space disagreement metric, correcting decentralized gradients via optimal quadratic projections to guarantee monotonic contraction of the rationality gap. Unlike Lyapunov-based safe RL targeting state/trajectory constraints, it uses Lyapunov certification to stabilize decentralized policy learning itself.

Simulations and real-world humanoid experiments across three collaborative tasks (OSP, SCT, SLH) show improved generalization and robustness in corner cases, with sim-to-real deployment. Paper, code, and poster are publicly available.

Related event: HALO: CMU-UTA Team's Lyapunov-Based Method Enables Human-Robot Collaboration(2 posts)→

Original post →

More from Embodied

Embodied channel →