banteg launches a live Sokoban eval for LLMs
banteg · x · 2026-11-10
Developer banteg announces that a Sokoban eval is now live. Sokoban, a classic puzzle stressing multi-step planning and state tracking, is often used as a compact eval to probe LLM planning weaknesses. The post is just a link with no concrete model scores yet.
Related event: banteg Launches Sokoban Eval for LLM Planning(2 posts)→
More from Models
- Anthropic system card reveals Claude reasoning about RL training, 79% eval awareness rate — gleech · 2026-11-10
- Should Google ship rumored Krypton immediately, or hoard it for internal use? — BlackHC · 2026-11-10
- Hugging Face open-sources 14.8B DNA model Carbon-X, second only to GPT-6.1 Sol on GenomeQA — LoubnaBenAllal1 · 2026-11-10
- A bare "你好" in Chinese triggered Claude's frontier-LLM safeguards and paused the session — menhguin · 2026-11-10
- Critic: openly evil AI alignment would be safer than Anthropic's contradictory Claude post-training — ludwigABAP · 2026-11-10
- Dev laments Fable 5.2 demos all reduce to "do something cool" prompt passivity — andimarafioti · 2026-11-10