MazeBench opens a 3D puzzle benchmark for coding agents with 200+ rooms
patience_cave · x · 2026-07-28
MazeBench: a public 3D puzzle benchmark for coding agents
MazeBench is an open-source local browser app for building persistent 3D puzzle worlds and evaluating coding agents inside the same JavaScript engine.
- The benchmark includes 200+ rooms and 100+ objectives (gems).
- It supports agent evaluation under different interfaces, including ASCII and Python-enabled modes.
- The posted leaderboard shows that giving agents Python can boost scores substantially, with GPT-5.6 Sol Max reaching 13%.
- The authors note that later puzzles are intentionally designed to be infeasible for A solvers, so current models have not yet reached those stages.
- They also use a novelty score to stop agents that start looping, keeping compute under control.
Related event: MazeBench Open-Sourced: 3D Open-World Benchmark for Long-Horizon Planning(14 posts)→
More from coding & agent
- Dev builds MCP layer so Claude Code can work on servers without ever holding SSH keys — NETMESAFE · 2026-10-16
- 'Refusing to code with AI in 2026 is like refusing Google in 2005' — prasenx · 2026-10-16
- Claude Code adds idle compaction to save 1h prompt cache on idle sessions — EricBuess · 2026-10-16
- Handling agents that crash mid-task: the hard part is the unknown outcome across the network — Responsible-Dare5139 · 2026-10-16
- OpenAI DevDay Community Hackathon heads to Berlin with developer, founder and GTM tracks — paw_lean · 2026-10-16
- Data scientist career path is shifting: ML skills no longer enough, AI engineering is the new bar — mdancho84 · 2026-10-16