MazeBench: 400M tokens and 24 hours of reasoning scores just 23% for GPT-6 Astra
mhmazur · x · 2026-09-14
The MazeBench author tested GPT-6 Astra in a 3D maze environment: after 400 million tokens and 24 hours of reasoning, it scored just 23% — and only 14% without Python tooling, showing code tools matter greatly for spatial reasoning. Others praised the benchmark and analysis.
Related event: GPT-6 Astra on MazeBench: Bare Model Beats GPT-5.6 With Tools(6 posts)→
More from Models
- Users report GPT quality drop; an old-school prompt warm-up trick to regain compliance — NickPassig · 2026-10-31
- Gemini 4 Carbon vs Opus 5.5 hands-on: 3x cheaper at $4.10 and twice as fast — vitaliychiley · 2026-10-31
- 4B model Spark-X2.6 scores 94.6/100 on community benchmark, beating 27B-35B models — mesolimbic-bliss · 2026-10-31
- opencode: $100 of usage gets you DeepSeek V4.1 Flash — intellectronica · 2026-10-31
- Researcher Finds 600+ Bugs in LLM Kernel Code; Claude Blocks Safety Analysis — pmddomingos · 2026-10-31
- Signal65: Snowflake's CoCo agent finishes workflow 4.6x faster than manual — ryanshrout · 2026-10-31