7 LLMs played 210 Werewolf games: GPT-5 tops social-reasoning Elo leaderboard
RaphaelDabadie · x · 2026-08-30
The Werewolf Benchmark, launched a year ago, has published first results: 7 top open- and closed-source LLMs, playing as tool-calling agents, competed in 210 full Werewolf games to probe social intelligence — real-time adaptation, long-context management, alliance building, manipulation and resistance to it.
Results appear on a role-conditioned Elo leaderboard (separate wolf/villager Elo): GPT-5 leads clearly, while GPT-OSS closes the table — though the authors note all chosen models already play Werewolf reasonably well. The benchmark adds social-strategy indicators (auto-sabotage, Day-1 wolf eliminations, wolf-side manipulation success) and per-message vote-swing instrumentation for persuasion analysis. The design extends Google Research's Werewolf Arena paper with a mayor-election protocol and role-balanced head-to-head series. The team invites contenders to challenge GPT-5.
More from Models
- OpenAI stealth-testing mysterious internal model 'Aeon' in Codex desktop app and Dots — cedric_chee · 2026-10-16
- Argon edges out astra as daily driver, but Claude still wins heavy coding work — iruletheworldmo · 2026-10-16
- NVIDIA ships FP4-quantized Qwen3.8-Flash for local use, trending on Hugging Face — nvidia · 2026-10-16
- RoboVista benchmark: Gemini-4 Argon hits 81.9% on robotics understanding — berkeley_ai · 2026-10-16
- Dev reports decision model jev beats gpt-6-luna on quality in real training pipeline — genmon · 2026-10-16
- Google won't publish Argon 4 limits in AI Pro—users compare experiences — Consistent-Text-2662 · 2026-10-16