Pretraining sets the floor, RL raises the ceiling: on how the two divide the work

JacquesThibs · x · 2026-11-23

JacquesThibs weighs in on the pretraining-vs-RL relationship: pretraining solidifies concepts into crisper representations and stores facts precisely, which RL can leverage via elicitation to complete complex, long-horizon tasks. Both determine the ceiling, but pretraining helps set the floor.

Original post →

More from Models

Models channel →