Self-play RL on one desktop beats Warcraft III's insane built-in AI

ToraxXx · reddit · 2026-10-19

warlock.ai published a WarcraftSim project writeup: the author trained an agent with self-play reinforcement learning (policy v267) on a single desktop to beat Warcraft III's built-in "Insane" AI.

The accompanying dashboard shows a live match — the learner (red Nightelf) vs the built-in insane AI (blue) — with reward curves, win estimates, resource (gold/lumber) comparison, and per-unit policy entropy, as the learner gradually overtakes the AI economically and militarily.

The simulation environment and training pipeline are open, making this a reproducible case of applying modern RL to a complex legacy RTS, with implementation details in the blog.

Original post →

More from Research

Research channel →