EDEN: anchored embedding noise boosts RLVR exploration beyond policy rollouts

Daijiao Liu · hf · 2026-10-16

UNSW Sydney researchers propose EDEN (Embedding-space Directional Exploration via anchored Noise) for RLVR: within each rollout group, a small fraction of standard rollouts is replaced by rollouts generated from the prompt plus a single appended perturbed embedding, with a shared anchor providing a common conditioning direction; perturbed rollouts enter GRPO updates with downweighted advantages, leaving architecture and inference unchanged. EDEN beats GRPO and standard exploration controls across math reasoning benchmarks at the same rollout budget, with the largest gains in sampled solution coverage.

Original post →

More from Research

Research channel →