LLM-as-a-Coach turns judge feedback into transferable experiential knowledge

iScienceLuvr · x · 2026-07-21

This is a duplicate share of the paper “LLM-as-a-Coach: Experiential Learning for Non-Verifiable Tasks.”

It proposes Experiential Learning (EL), which converts LLM-as-a-Judge style feedback into an LLM-as-a-Coach. Rather than reducing evaluation to a scalar reward, the coach distills its judgment into transferable experiential knowledge that conditions a teacher model and is absorbed by the policy via on-policy context distillation.

The paper’s main claim is that this richer feedback signal improves open-ended, non-verifiable tasks, generalizes better out of distribution, and reduces reward hacking compared with rubric-based RL.

Related event: Microsoft Proposes LLM-as-a-Coach to Convert Feedback into Transferable Experience(3 posts)→

Original post →

More from Research

Research channel →