Sokoban eval for LLMs: gpt-6.2 sol lands #2, astra #3; humans invited to beat model routes
banteg · x · 2026-11-18
Developer banteg launched a Sokoban puzzle benchmark where language models play Jonah Ostroff's 66-room trilogy, submitting moves or full-room plans each turn, replayed in the original PuzzleScript game. gpt-6.2 sol and astra (medium effort) both cleared it, ranking #2 and #3. The site also challenges humans: models hold shortest-route records in every room, but shorter routes exist.
Related event: banteg's Sokoban Benchmark: GPT-6.2 Models Clear All Levels(3 posts)→
More from Models
- Tesla FSD 15's real-time view isn't 3D rendering — it's the AI model's own synthetic perception — mark_k · 2026-11-22
- Gemini Black Friday half-price: JP-region trick gets Pro annual plan for $91.54 — huangyun_122 · 2026-11-22
- Microsoft's USB4 RDMA lets mini PCs pool memory to run Qwen3-235B — JFPuget · 2026-11-22
- Google AI Mode now enforces usage limits, users surprised by rate-limit popup — elvano124 · 2026-11-22
- Sol 6.2 now refuses reverse engineering that Sol 6.1 happily did for a month — cardak98 · 2026-11-22
- Anthropic's record ~$81B IPO, GPT-6.2 pricing, Qwen4-Max and Copilot Autopilot: week in review — ksraj1001 · 2026-11-22