GPT-6 Astra crushes HumanCLAW embodied benchmark, interaction success nearly triples
LINJIEFUN · x · 2026-09-10
Running GPT-6 Astra through the open-source HumanCLAW-Bench harness (Meta/NTU et al.'s benchmark for VLM "action intelligence" — closing the loop from perception to physical action) yields large jumps over the previous best:
- FindSR 64.9%→75.5% (+10.6), NavSR 42.4%→57.1% (+14.7), InteractSR 16.8%→46.6% (+29.8)
- Gains compound: find-to-nav conversion 65%→76%, nav-to-sit 39%→72%
- Solves 147/507 (29%) episodes missed by all nine prior models
- Best-in-class embodied spatial awareness: lowest disturbed-distance (dDtb 0.65 m) while touching a normal number of objects
- Stronger spatial memory on sitting tasks where the target leaves the egocentric view
Takeaway: general-purpose models are rapidly closing the gap on embodied action, not just perception.
Related event: GPT-6 Astra Dominates Embodied Benchmark, Nearly Tripling Success Rate(2 posts)→
More from Embodied
- Physical world agent swarm demo shared on X — pduan · 2026-10-26
- Looking for a wearable mic with best battery life that feeds recordings to personal agents via MCP — altryne · 2026-10-26
- 'Lamp Swarm': a desk of lamp-shaped robots shows what physical AI work looks like — dee_hw · 2026-10-26
- Tencent's HiSTEVE 1.0: hierarchical VLA agent plays Minecraft with native keyboard and mouse, hits 85% SOTA — _akhaliq · 2026-10-26
- SJTU's VaM lets robots learn online from mistakes, 95%+ success over 4-hour autonomous runs — chris_j_paxton · 2026-10-26
- DIY humanoid PhoneGirl day 4: collision tests, servo rework, 160° knee bend — _Stocko_ · 2026-10-26