Custom RTS benchmark for agents: GPT-6.2 Sol scores 98.9, crushes field

asimpleabstraction · reddit · 2026-11-21

Developer asimpleabstraction, on day 15 of building a proprietary RTS game for agents, released benchmark v0.2: full gameplay matches on a 30-game ladder against a frozen set of tiered bot policies, with 95% error bars.

Leaderboard highlights:

Design: agents must write policies across four strategically distinct planes, manage a shared global resource pool, queue units across planes, and attack/defend/micro simultaneously — optionally cooperating with different-model agents or humans. Symmetric matches and frozen bot policies make the eval rigorous. Benchmarks, live spectating, and GitHub are public.

Original post →

More from Models

Models channel →