Grok 4.20 stuck 700 turns in a Pokémon Red house while narrating its own loop

VibeCodyH · reddit · 2026-11-01

Turn logs from PokeBench (a benchmark where vision models play Pokémon Red) show Grok 4.20 non-reasoning leaving the starting house at turn 36 but not getting a starter until turn 755, burning $30 vs Grok 4.6's $10 to beat Brock in 316 turns. The model's notes repeatedly acknowledge the loop ("oscillating uselessly for 90+ turns") yet it keeps walking into walls. The author asks: is this a vision problem or a planning problem?

Original post →

More from Fun

Fun channel →