RT-SAFE benchmark: agents hit 94.1% task success but only 0.7% safe success in real-time embodied settings

Lianhuiq · x · 2026-10-13

RT-SAFE (arXiv:2610.09294) benchmarks embodied-agent safety under real-time constraints in a simulated urban environment where the world keeps evolving during inference. Across eight VLMs, task completion is high but only 0.7% of episodes in the hardest setting finish without a safety event; real-time execution increases collisions 12.3x versus static evaluation (94.1% vs 91.3% task success), showing that decision latency itself is a safety risk.

Related event: RT-SAFE Benchmark Exposes Real-Time Safety Blind Spot in Embodied AI(5 posts)→

Original post →

More from Embodied

Embodied channel →