Brood War Bench Shows LLMs Can't Beat RTS Novices

Developer Ben Swerdlow created Brood War Bench, testing LLM agents playing StarCraft: Brood War directly. Mainstream models all lost to novice players, while Codex Astra topped the leaderboard with a 100% win rate.

2026-09-21 ~ 2026-09-22 · 2 related posts

• Brood War Bench: Codex Astra goes 18-0 while no model plays beyond beginner level — steipete · 2026-09-21
• Brood War Bench Pits LLM Agents Against StarCraft — Every Model Loses to Novices — dotey · 2026-09-22