Researchers debate RLVR's lineage: 'RLHF was the weird one, STaR was already around'

soldni · x · 2026-10-15

In a discussion on whether RLVR (RL with verifiable rewards) was a genuinely new idea, soldni argues the idea existed but known recipes weren't broadly available in the literature the way tool use recipes were.

lateinteraction counters that RLVR is just RL—RLHF is the more elaborate/weird one—and STaR arrived soon after; using RL for chain of thought in early 2021 would have been remarkable, but this wasn't that.

Related event: Researchers Trace RLVR's Roots: It's Just RL, and the Idea Isn't New(3 posts)→

Original post →

More from Research

Research channel →