GPT-6 Astra Scores Just 23% on MazeBench After 400M Tokens and 24 Hours of Reasoning
patience_cave · x · 2026-09-14
Running GPT-6 "Astra" with Python code execution on the MazeBench 3D environment benchmark consumed 400 million tokens and 24 hours of reasoning for a final score of just 23%; without Python, Astra drops to 14%.
The author notes Astra understands basic spatial concepts like walking beneath archways, but becomes unreliable in longer tunnels — 3D spatial reasoning still has plenty of room to grow.
Related event: GPT-6 Astra on MazeBench: Bare Model Beats GPT-5.6 With Tools(6 posts)→
More from Models
- EachLabs launches Lockstep recast model claiming 75% cost cut and better quality — miilesus · 2026-10-30
- ChatGPT cited a 300+ page government legal PDF it retrieved on its own — lilyraynyc · 2026-10-30
- Best MLX model for French-to-English translation on an M2 Mac? — greenreddits · 2026-10-30
- AI-driven cyber ops near the sophistication peak set by GTG-1002's Claude Code campaign — Jsevillamol · 2026-10-30
- Cognition FrontierCode chart pits Mistral Large 4 vs Chinese open models, sparking debate — onetwoval · 2026-10-30
- NVIDIA's Nemotron 3.5 Super hits 51.78% on SWE-bench Pro with 4.6x fewer active params — dair_ai · 2026-10-30