UniPred, accepted at IEEE T-RO 2026, invents task concepts from demonstrations for long-horizon robot planning

tomssilver · x · 2026-10-28

UniPred, a paper from CMU, UMich, Princeton and partners, is accepted to IEEE Transactions on Robotics 2026 (SI on Foundation Models for Robotics). The core problem: robot planners rely on predicate concepts over long-horizon tasks, but demonstrations only label actions. UniPred invents those concepts with an agent-in-the-loop scheme: an LLM agent proposes when a concept becomes true/false, a neural classifier learns it from demonstration image features, and inconsistent proposals stay high-loss, prompting the agent to revise until concepts separate cleanly. A planner chains learned concepts into long tasks with recovery when a skill misfires; the same learning works from object states, point clouds, and camera images. Authors include Tom Silver, Katia Sycara, and Sebastian Scherer.

Original post →

More from Embodied

Embodied channel →