GPT-6 Astra Beats Gemini 3.8 Flash in Paired Robot Test, Yet Neither Completes the Task
qinzytech · x · 2026-10-27
Embodiment Analysis ran a paired robot comparison on identical layouts, tasking models to "put the banana in the bowl, then the cube." GPT-6 Astra was preferred over Gemini 3.8 Flash: Astra acted on the required first target and brought the banana to the bowl, while Flash left both objects outside.
Strictly scored, neither run earned task completion: Astra's banana ended across the rim rather than inside the bowl, and the cube stayed outside in both runs. The analysis stresses that rim contact doesn't establish placement — a showcase of rigorous embodied evaluation methodology.
More from Embodied
- 3am open-heart surgery on a Unitree G1 in Zurich sparks 'robot hospitals' meme — lukas_m_ziegler · 2026-10-27
- RTX Spark laptops impress analyst: 30B local model runs quiet with great battery life — Scobleizer · 2026-10-27
- Re-uploading a 239GB robot dataset moved only 2.6MB — inside a petabyte-scale data pipeline — mervenoyann · 2026-10-27
- ROSCon UK photo tour: BBC's whale robot, da Vinci surgical robot and the OG PR2 — kamathsblog · 2026-10-27
- Teardown of a humanoid robot Z-axis linear actuator, with Zmotor Q&A — MarwaEldiwiny · 2026-10-27
- Teardown of Zmotor LA500 humanoid linear actuator: 324 g, 500 N peak thrust — MarwaEldiwiny · 2026-10-27