RLAF: Nace AI trains decision models with a reasoning model as judge

nischay_twt · x · 2026-11-07

In a new paper on Foundation Decision Models, Nace AI researchers propose Reinforcement Learning from Adjusted Feedback (RLAF): a reasoning model that spends tokens on thinking trains another model to make decisions without generating answer tokens. RLAF combines verified outcomes with probabilities assigned by a generative judge — for Drex Max, a Qwen3.8-27B base model run at high reasoning effort — instead of training against a single correct label.

Original post →

More from Models

Models channel →