Robot-arm test finds most LLMs don't know when to stop
An Artificial Analysis robot-arm test showed Claude Opus 5.5 kept pushing uselessly for 22 minutes after finishing its task, with only GPT-6.1 Sol and Gemini 4 Argon stopping within a minute of completion—showing 'knowing when to stop' remains hard for LLMs.
2026-11-04 ~ 2026-11-04 · 2 related posts
- Episode 1: Artificial Analysis Launches AA-Robotics Benchmark; GPT-6 Astra Tops Ranking(2026-10-15, 3 posts)
- Episode 2: Robot-arm test finds most LLMs don't know when to stop(2026-11-04, 2 posts)
- Knowing when to stop is hard: Claude Opus 5.5 pushed a crocodile for 22 extra minutes — ArtificialAnlys · 2026-11-04
- Only GPT-6.1 Sol and Gemini 4 Argon stopped within a minute on robot arm task — ArtificialAnlys · 2026-11-04