RLVR Is Guaranteed to Sigmoid: Verifiers Bounded by Human-Written Math Can't Escape ZFC
Liu_eroteme · x · 2026-09-29
A substantive technical take: current RLVR relies on human-written verifiers (and agent-written ones inherit the same limits), so the approach is guaranteed to follow a sigmoid curve. If the verifier is a subset of ZFC, RLVR cannot train an agent to prove theorems beyond ZFC — no policy gradient exists to distinguish 'impossible' from 'hard'. The author sees RLIR on real-world interaction as the only unbounded path, but it's ratelimited by real time.
Related event: RLVR Is Capped by Verifiers, Limiting Path to Superhuman AI(3 posts)→
More from AGI Musings
- Malthus Saw It in 1798: Wealthy Avoiding Kids, Delayed Marriage Repeats Today — SydSteyerhart · 2026-11-16
- Runway CEO Predicts Fully AI-Generated Cultural Phenomenon by 2027 — c_valenzuelab · 2026-11-16
- '5% worse and 10% cheaper': the button with no vote is already everywhere — eigenrobot · 2026-11-16
- Effective Altruism is top-down and hierarchical, not a grassroots movement — ctjlewis · 2026-11-16
- Lawyers say clients' AI use creates unrealistic expectations and fake case law in settlements — hoofnagle · 2026-11-16
- Dev debunks 'rogue AI' hype: subsidized subscriptions can't fund expensive swarms — gerardsans · 2026-11-16