TREK Enhances GRPO via Distillation-Driven Exploration

TREK is a novel policy optimization framework that uses knowledge distillation during the exploration phase to help GRPO find verified correct solutions when student models repeatedly sample wrong paths, improving performance on math and agent tasks.

2026-07-08 ~ 2026-07-10 · 2 related posts