GoBench: LLMs hit 2500 Elo on 9x9 Go vs KataGo's 4400, r=0.83 with ARC-AGI 2
Roland31415 · reddit · 2026-09-17
GoBench evaluates LLMs on 9x9 Go against a ladder of KataGo opponents from random to superhuman:
- Measures general reasoning ability, strongly correlated with ARC-AGI 2 (r=0.83), and far from saturated
- GPT-6 Astra max reaches 2500 Elo, well below top KataGo's 4400
- With coding tools and two hours of prep, Codex with Astra reaches 3560 Elo, showing tool use narrows the gap
Leaderboard, code and paper are public; the author pledges to keep updating the board.
Related event: GoBench: Testing LLM Reasoning Through the Game of Go(2 posts)→
More from Models
- AWS's open-source Strands Harness claims 45% cheaper than Claude Code, reigniting harness debate — blaizedsouza · 2026-11-02
- Yacine calls Terra High 'kind of an insane model' — yacineMTB · 2026-11-02
- Running DeepSeek V4.1 on a single H200 at $5.30/hr — daluoseo · 2026-11-02
- Leaked Fable 5.5 checkpoint video called 'pure code' — 'will change the game' — kimmonismus · 2026-11-02
- Claude Opus 5.5 quality complaints spark debate on why continual learning is so hard — JeremyNguyenPhD · 2026-11-02
- Why is AI sexist? Reddit debate on models overlooking Iceland's women's strike — Mathemodel · 2026-11-02