MazeBench is a 3D benchmark that leaves today’s agents stuck in the opening rooms
patience_cave · x · 2026-07-28
- MazeBench is introduced as a 3D open-world benchmark for long-term planning and visual-spatial reasoning.
- It contains hundreds of rooms and puzzles; the authors say current agents cannot get past the initial levels.
- A follow-up note adds that agents must traverse more than 200 rooms to find 100 hidden gems via Sokoban-like box-pushing puzzles, with difficulty ramping quickly.
- The team also reports that models were tested in native harnesses with camera/player tools, yet performance stayed extremely poor across image, ASCII, and JSON representations, topping out at 1%.
- To prevent endless loops, they used a novelty score to stop agents when they began circling.
Related event: MazeBench Open-Sourced: 3D Open-World Benchmark for Long-Horizon Planning(14 posts)→
More from coding & agent
- Gemini shown off modding Minecraft to turn players into any Spider-Man — zacharynado · 2026-10-16
- IBM engineer maps 5 levels of AI coding, from manual to a 3-day agent software factory — TejasKumar_ · 2026-10-16
- 10 open-source repos that let your AI agent reverse-engineer apps and games — victor_explore · 2026-10-16
- The new CTO job: agent management and QA loops, 'cable management' instead of coding — HankYeomans · 2026-10-16
- Why company AI agents go stale: adoption needs in-house knowledge, not just better agents — EdenEmarco177 · 2026-10-16
- Open-source MCP lets coding agents search Obsidian's 9,000-plugin directory before reinventing wheels — pitfa19 · 2026-10-16