GPT-6 Astra scores 95% on robot control task — but critics say demos are gamed
GaryMarcus · x · 2026-09-08
chooijeq reported that GPT-6 Astra scored 95% on a robot control task, up from Fable 5.1's 40%, with 6.2x fewer output tokens at 2.3x lower cost.
Developer ChombaBupe pushed back, calling it evidence Astra is not AGI: visual perception demos typically use brightly colored simple shapes on clean backgrounds to make tasks easy for the system. Gary Marcus amplified the critique.
More from Embodied
- Arm's CSS for Mobile 2 Skips the NPU, Bets On-Device AI on CPU and GPU Engines — ryanshrout · 2026-09-08
- Non-engineer builds a modern HP Jornada palmtop with GPT-6 Astra doing the engineering reasoning — Wuliyasi · 2026-09-08
- Weekend Hack Pays Off: DIY Robot Achieves Autonomous Obstacle Avoidance — _Stocko_ · 2026-09-08
- XPENG's IRON becomes first humanoid to walk off its own production line, targeting 1,000 units/month — CyberRobooo · 2026-09-08
- Meta's HumanCLAW benchmark: top VLMs fail badly at acting through a body across 1,218 tasks — wzenus · 2026-09-08
- First Cybercab ride: 'exceeded my expectations' with surprisingly roomy interior — jevon · 2026-09-08