Toby Ord stands by his RL thesis: lower bits-per-FLOP ceiling explains today's jagged AI capabilities

tobyordoxford · x · 2026-09-24

Philosopher Toby Ord reaffirms his essay's thesis after being asked if he updated on the "RL doesn't have enough bits" theory: RL has a much lower ceiling on information learned per FLOP than pretraining, raising questions of why it works and how far it can go — partly answered by the bits being highly relevant. He notes his predictions held up, including RL-era AI getting much better at a subset of tasks: today's "jagged" capabilities.

Related event: Toby Ord Stands by RL Information-Bottleneck Thesis in Exchange with Millidge(5 posts)→

Original post →

More from AGI Musings

AGI Musings channel →