VPO: A Training Method to Boost Solution Diversity

bronzeagepapi · x · 2026-07-19

Vector Policy Optimization (VPO) is a training method designed to mitigate the issue of "declining solution diversity," a problem that limits the gains achieved during test-time search.

The training pipeline roughly works as follows: the model sequentially generates multiple candidate answers, which are evaluated using multiple objectives and randomized reward weights. The highest-scoring solution for each set of weights is then selected and averaged to produce a scalar reward. The author notes that this reward calculation method can be combined with GRPO.

Original post →

More from Research

Research channel →