Watch, Infer, Coordinate: robots infer a partner's physical limits from watching teamwork, then coordinate zero-shot

mangahomanga · x · 2026-10-06

Researchers from Honda Research Institute USA and Johns Hopkins introduce Watch, Infer, Coordinate: a helper robot observes a partner working with another robot, infers the partner's physical constraints (e.g., from hardware degradation or actuator faults), then coordinates with it zero-shot on a new task. The key insight is that physical constraints shape joint team behavior, so both robots' actions reveal the constrained partner's capabilities — even when the partner's own teammates compensate for its limits. The release includes a benchmark spanning three physically coupled manipulation settings, with their inference approach substantially improving constraint inference and zero-shot coordination across all three.

Original post →

More from Embodied

Embodied channel →