REAL: an embodied agent that explores real rooms and asks clarifying questions, accepted at ECCV 2026
jiqizhixin · x · 2026-09-23
REAL, accepted at ECCV 2026, targets two over-idealized assumptions in embodied simulation: fully observable environment state and perfectly clear user intent. The framework unifies active exploration, visual goal localization, natural language intent disambiguation, and physical manipulation into one decision loop, using first-person RGB as the primary perception input. In a real-room demo, given only "get me something to eat," the robot explores, finds a bread and two donuts, asks which one the user wants, and acts on the feedback — no privileged information, no explicit instructions, sim-to-real deployable.
More from Embodied
- Homebrew robot arm build log Day 7: geartrain CAD, wiring and gripper sizing — _Stocko_ · 2026-11-11
- Perceptron AI launches EgoHome, an open benchmark for sub-second egocentric hand understanding — rohanpaul_ai · 2026-11-11
- Runway open-sources Praxis-1, turning video pretraining into real robot control — runwayml · 2026-11-11
- Unitree G1 humanoid wearing VR goggles pilots an A1 drone in land-air robot demo — CyberRobooo · 2026-11-11
- CoRL Spotlight Meta-Ctrl predicts robot plan failures, Llama 3 8B beats GPT-5.5 on VirtualHome — guyvdb · 2026-11-11
- Luna, a jewelry-style AI wearable that speaks before you ask, launches on Kickstarter — nikola_mr64990 · 2026-11-11