GPT-5.6 Fails at Tracking Board Game States in Images
Hot_Path4185 · reddit · 2026-07-17
A Reddit user tested GPT-5.6 (High) on its ability to track board game states across a sequence of images, finding its performance unstable in Nine Men's Morris.
The testing method involved:
- Using screenshots from the mini-game in Assassin's Creed IV: Black Flag
- Providing a new image of the board state for every move
- Asking the model to continue playing based on the sequence of images
Results showed that the model gradually lost memory of piece positions. It even made moves that ignored existing pieces on the board, ultimately failing to find a clear winning path.
The poster wanted to know if this is a known weakness: whether the model struggles specifically with visual board state tracking, or if it's a broader issue with sequential image reasoning.
More from Models
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11
- awesome-llm-leaderboards: an open-source directory of LLM leaderboards, pricing tables, comparison tools — Last_Establishment_1 · 2026-09-11
- Anthropic claims it works to keep eval environments unidentifiable to models — MaxKannen · 2026-09-11
- Nex N2.5 Pro released on Hugging Face with 407GB of weights — jinnyjuice · 2026-09-11
- RoMa v2 image matching model unveiled in the usual black poster — ducha_aiki · 2026-09-11
- OpenAI rated Astra 'Critical' for cyber capabilities — and admits it's harder to monitor — theguywhobuilds · 2026-09-11