Paper and code released: Multi-LLM Collaborative Alignment via Stackelberg Games

shangbinfeng · x · 2026-10-20

The Stackelberg Alignment paper (arXiv:2609.39076) and code are now public. Co-led by Christina Hahn and Shangbin Feng with Dean Light, Swastik Roy, Hila Gonen, and Yulia Tsvetkov, building on Sparta Alignment. The abstract notes existing methods sample instructions uniformly even as their usefulness shifts with model progress; the framework instead uses an EXP3 bandit to adaptively allocate sampling budget by difficulty and discriminativeness, with Elo-style reputation-weighted peer judgment, achieving the highest macro-average across 3 model pools and 12 benchmarks.

Related event: Stackelberg Alignment Turns Multi-LLM Disagreement into Collaborative Training Signal(5 posts)→

Original post →

More from Research

Research channel →