A maze benchmark tests models’ spatial memory and tool use with 45° moves
TheRealMasonMac · reddit · 2026-07-25
The author built a maze benchmark to test models’ spatial awareness, memory, and tool use. The environment requires finding a key, opening a door, and then escaping, with observations generated after each action.
To make the task tractable, the benchmark provides tools such as moving forward/backward, turning in 45° increments, opening doors, and picking up items. The author also adds extra clarity about crossable tiles after models got lost. Early runs show GPT-5.4 mini and GLM-5.2 looping, while K2.6 completed it more efficiently. GLM-5.2 consumed about 62 million tokens, versus 9 million for K2.6, though the author notes this is not a fair direct comparison because thinking preservation settings differed.
More from coding & agent
- DeepMind paper: LLMs can't sample randomly on their own — pass random numbers from code instead — rohanpaul_ai · 2026-10-27
- BELL: Open-Source Stack Combines Browserbase, Eve, iMessage and Stripe Link for Personal Agents — jeff_weinstein · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Two engineers rebuilt a FedEx supplier's billing core in 3.5 months vs an estimated 7-8 — alex_verem · 2026-10-27
- GPT-6.1 Terra scores 48 on AA Coding Agent Index at one-third the cost of GPT-5.6 Terra — ArtificialAnlys · 2026-10-27
- Shift-1 router cuts coding agent spend up to 55% while keeping SWE-bench accuracy — ypatil125 · 2026-10-27