Has GPT-6-Astra Achieved Embodied Intelligence? A 12-Benchmark Evaluation

sensenova · hf · 2026-10-19

A joint team (SenseNova, ACROB, Ropedia, NTU Singapore, Univ. of Tokyo) evaluates GPT-6-Astra's embodied capabilities across 12 benchmarks spanning tabletop manipulation, humanoids, mobile platforms and dexterous hands, achieving unprecedented results under a unified protocol allowing in-context learning from demonstrations.

The paper identifies key gaps: demonstration cost and execution time, physical-state verification and recovery from irreversible failures, and long-horizon progress preservation. It finds that close-loop coordination between a high-level "System 2" reasoner and a low-level "System 1" controller is costly but effective, and real-world deployment experiments reveal substantial practical gaps.

Related event: GPT-6-Astra Embodied Evaluation: Strong Benchmarks, Real-World Gaps(4 posts)→

Original post →

More from Embodied

Embodied channel →