Exploration-Distillation RL framework claims big gains; Lucas Beyer asks for citations

giffmana · x · 2026-10-14

micahgoldblum announced Exploration-Distillation, an RL framework claiming aggressive exploration and large performance boosts over standard algorithms like DAPO — in principle enabling LLMs to discover new things during RL.

Google DeepMind's Lucas Beyer replied asking them to cite his 2019 paper MULEX, which pioneered disentangling exploration from exploitation in deep RL with parallel losses and a shared replay buffer — and which has just 17 citations.

Related event: NYU's Exploration-Distillation Decouples Exploration from Optimization in RLVR, Beating DAPO(7 posts)→

Original post →

More from Research

Research channel →