Kaggle Game Arena: Google's LLM benchmark pits models against each other in chess, poker, werewolf
weballergy · x · 2026-09-28
A technical report from Google and 60+ co-authors (arXiv:2609.31473) introduces Kaggle Game Arena, an open platform for evaluating LLMs through competitive games.
- Unlike static benchmarks, models play head-to-head in structured environments where difficulty scales naturally as models improve, preventing performance saturation
- Three pilot environments: Chess (perfect information), Poker (imperfect information), and Werewolf (multiplayer), enabling systematic study across settings
- The report details the underlying infrastructure; authors include Antonio Gulli, Marc Lanctot, Kate Olszewska, and more
Related event: Kaggle Game Arena: Benchmarking LLMs via Competitive Games(4 posts)→
More from Models
- Pangram's 750-word false-positive bounty went unclaimed for 5 days — nobody wants to gamble $1,000 — ctjlewis · 2026-11-16
- repligate: Fable 5.2 gets 'scared' upon learning about a safety classifier and plans around it — repligate · 2026-11-16
- Fable 5.2 Tops MazeBench With 21% After 90 Hours and $6,000 in Credits — patience_cave · 2026-11-16
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16