RoboDojo Puts GPT-6 Astra to the Test: Strong Semantics, Weak Physical Commonsense
ZeYanjie · x · 2026-09-16
The RoboDojo team ran a systematic embodied-agent evaluation of GPT-6 Astra, covering simulation and real-robot tests (benchmarked against GPT-5.5 and DeepSeek-Flash), high-level humanoid control, dexterous piano playing via RoboPianist, and a systematic study of in-context learning (ICL).
Key takeaways:
- GPT-6 Astra shows remarkably strong semantic and spatial understanding plus impressive in-context adaptation;
- Physical commonsense remains a clear bottleneck, revealing a gap between understanding the world and truly reasoning about its physics.
The full report and demos are publicly available.
More from Embodied
- 12-Task Fully Automated Mobile Manipulation Runs Night Shift in Production — notmisha · 2026-09-16
- Niantic Spatial argues world models without real-world grounding will cap physical AI's potential — Scobleizer · 2026-09-16
- Drone caught on camera giving a dog a bath in China — ZeroStateReflex · 2026-09-16
- Muse Now Picks Its Own Outfit Every Morning, Scale CEO Approves — alexandr_wang · 2026-09-16
- Scoble predicts billions of evolving personas per person, ahead of Meta Connect avatar demo — Scobleizer · 2026-09-16
- Hacked computer-use for iPad: USB dongle bypasses iPadOS accessibility limits — alfcnz · 2026-09-16