Skeptic pushes back: math breakthroughs came from RL, not pretraining perplexity

stochasticchasm · x · 2026-11-23

Reacting to OpenAI's claim that upgrading to a model of log-perplexity 0.76 started producing groundbreaking results, stochasticchasm argues that math discoveries and the explosive capability gains in math were primarily driven by RL, not pretraining—so attributing breakthroughs to a perplexity threshold feels off.

Related event: OpenAI's Perplexity Narrative Questioned: RL, Not Pretraining, Drove Math Breakthrough(2 posts)→

Original post →

More from Models

Models channel →