Nathan Lambert maps post-training's open problems as RL compute surpasses pretraining

rickasaurus · x · 2026-11-22

Nathan Lambert released a slide deck on the biggest open problems in post-training and the field's evolution, outlining Trillium Labs' goals. Key research areas: harness specialization and environment design for context management, character training (model personality, safety, trust), and open-source RL environments. The deck ends with a debate on how RSI is changing research. Accompanying data shows RL compute share exploding: DeepSeek R1 used 5% as much RL as pretraining compute, while Beam (Oct 2026) spent >1.7× more on RL (7.1M vs <4.1M GPU-hours) and Inkling 2 Small 4×.

Related event: Nathan Lambert shares post-training open problems deck, says RL compute tops pretraining(3 posts)→

Original post →

More from Models

Models channel →