Salesforce Research open-sources IVG: closed-loop eval for visual AI assistants across 315 scenarios
RulinShao · x · 2026-11-10
Salesforce Research unveils Interactive Visual Gym (IVG), an open simulation framework for closed-loop evaluation and training of visual AI assistants. It recreates cooking, household and phone tasks with simulated users who act, make mistakes and ask questions, testing how accurately and promptly assistants help in real time. 14 assistants, 315 scenarios — Gemini-4-Argo leads. The thesis: future agents go beyond turn-based LLMs toward proactive, multimodal real-time interaction.
More from Embodied
- Johns Hopkins lab hiring postdocs in embodied intelligence, applications due Dec 11 — mangahomanga · 2026-11-10
- HARP-Bench: learned robot policies score 6-19% on 37 tasks involving humans — gan_chuang · 2026-11-10
- Prediction: a major lab will solve robotic intelligence by end of 2027 — alexmacgregor__ · 2026-11-10
- One Euler step suffices: VLAs get 1.6-4.8x faster with no retraining — kaixhin · 2026-11-10
- 6-8K CAD Local LLM Rig: M5 Ultra 96GB, M5 Max 128GB, or a Big-RAM Custom PC? — EfficientDivide1572 · 2026-11-10
- ODE Policy learns action dynamics via neural ODEs for multimodal robot trajectories — ntumars · 2026-11-10