MazeBench Update: Grok explores most, Gemini Flash solves puzzles while others struggle with T-shaped blocks
patience_cave · x · 2026-08-25
New MazeBench results for coding agents:
- Grok 4.6: Explored the most rooms (6), but scored 0% on solving puzzles.
- Gemini 3.7 Flash: Scored 1%, the only model to solve puzzles (collecting gems), outperforming Kimi K3.
- Others: ox-alpha, glm, and qwen all scored 0%.
Behavioral Observations:
- ox-alpha, glm, and qwen struggled with a "T-shaped" block, failing to push it down a correspondingly shaped hole.
Related event: MazeBench maze eval: flagship models score 0%, Gemini 3.7 Flash leads(4 posts)→
More from coding & agent
- Developer builds inter-agent messaging for his AI agents — complete with message undo — baditaflorin · 2026-10-16
- How Codex Happened: inside OpenAI's comeback in coding — danshipper · 2026-10-16
- iOS 'dots' workflow: one Siri command turns screenshots into a background shopping and saving agent — nickbaumann_ · 2026-10-16
- Your widget tree is already a list of options: where Jev fits in Flutter — rseroter · 2026-10-16
- How OpenAI's Codex went from failed side project to 40M weekly users in under a year — danshipper · 2026-10-16
- Photon 2.0 launches unified messaging API for AI agents across iMessage and more — Scobleizer · 2026-10-16