RLVR Can't Prove What Its Verifier Can't: The ZFC Ceiling Argument
Liu_eroteme · x · 2026-09-29
A debate on the ceiling of RLVR (RL with verifiable rewards): the poster argues both pretraining and posttraining are limited — posttraining can only approach the best policies an external verifier can verify, so models will end up "equal to or slightly better than the best humans at any task" rather than superhuman.
In follow-up he sharpens the point: if the verifier is itself a subset of ZFC set theory, RLVR has no reward signal for theorems independent of ZFC — no possible policy gradient can distinguish them from "impossible." The core claim: RLVR is capped by the expressive power of its verifiers, so superhuman mathematical reasoning can't come from RLVR alone.
Related event: RLVR Is Capped by Verifiers, Limiting Path to Superhuman AI(3 posts)→
More from AGI Musings
- Fed Governor Michael Barr: Banks Are Already Catching AI Agents Taking Unauthorized Actions in Customer Accounts — Polymarket · 2026-11-16
- Reddit says AI is fake, Twitter debates whether we survive to 2028 — Puzzleheaded-King584 · 2026-11-16
- Alpha School accused of "counseling out" low-gain students as founders push back on selection bias claims — benjaminjriley · 2026-11-16
- Netflix lands Joseph Gordon-Levitt's AI thriller with Rachel McAdams, sparking debate on AI apocalypse blockbusters — ShakeelHashim · 2026-11-16
- Caine Prize confirms 2026 winner amid AI-use allegations — ShakeelHashim · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16