Microsoft's Rubric Response Theory beats GRPO by up to 5.6 points with half the judge budget
microsoft · hf · 2026-10-02
Microsoft proposes Rubric Response Theory (RRT), replacing naive rubric-score summation in RL with a two-parameter item response model that treats verdict patterns as evidence about scalar quality. A Response Parameter Network predicts criterion difficulty/discrimination and is updated via online EM. With Qwen3.5-4B as policy, RRT scores 1.7 macro points above GRPO across four benchmarks and 2.8–5.6 points on hard criteria, while adaptive Fisher selection at half the judge budget stays within 0.1 points of GRPO.
More from Research
- In business, Type 2 errors often cost more than Type 1 errors — mdancho84 · 2026-11-16
- In risk management, missing a real risk can sink the business — mdancho84 · 2026-11-16
- Cost of Type 2 error: a missed pregnancy delays prenatal care — mdancho84 · 2026-11-16
- Cost of Type 1 error: a false alarm is usually temporary and clarifiable — mdancho84 · 2026-11-16
- Thread defines Type 2 error: false negative means missing a real effect — mdancho84 · 2026-11-16
- Thread defines Type 1 error via pregnancy test: false positive explained — mdancho84 · 2026-11-16