MicroPlanBench: No SOTA VLM Beats 70% on Robot Next-Step Planning

A new benchmark pair, MicroPlanBench and MicroAnnotationBench, shows no SOTA multimodal model exceeds 70% on robot next-action planning, with about a third of predictions failing—GPT-6 Astra leads, while GPT-6.1 Sol matches closely at one-fifth the cost.

2026-10-20 ~ 2026-10-21 · 3 related posts