Only GPT-6.1 Sol and Gemini 4 Argon stopped within a minute on robot arm task
ArtificialAnlys · x · 2026-11-04
Artificial Analysis added stop-timing comparisons for the robot arm task:
- Only GPT-6.1 Sol and Gemini 4 Argon stopped within a minute of completing the task
- GPT-6 Astra submitted 3 minutes after the passing state
- Claude Fable 5.1 kept going for 7 minutes
- Claude Opus 5.5 pushed on for a full 22 minutes
The data shows knowing when to stop is a widespread weakness, not unique to one model.
Related event: Robot-arm test finds most LLMs don't know when to stop(2 posts)→
More from Embodied
- Fruit fly's 166,000-neuron circuit map is being used to drive robot behavior — CurieuxExplorer · 2026-11-04
- Six AgiBot G2 humanoids run a Shanghai convenience store for 24 hours, logging 1,730 tasks — yogthos · 2026-11-04
- Corebrum OS: open-source Physical AI OS now installable on NVIDIA Jetson and any Ubuntu machine — chrismatthieu · 2026-11-04
- Artificial Analysis launches AA-Robotics benchmark: GPT-6 Astra tops robot arm control at $16.36 per task — ArtificialAnlys · 2026-11-04
- Knowing when to stop is hard: Claude Opus 5.5 pushed a crocodile for 22 extra minutes — ArtificialAnlys · 2026-11-04
- Waymo expands South Bay coverage with Berryessa and Milpitas BART connections — reed · 2026-11-04