RL framework teaches LLMs to self-learn from textbooks, lifting proof accuracy 51.5%→79.5%

_akhaliq · x · 2026-11-13

A new RL framework lets LLMs self-learn from structured textbooks: with fine-grained rewards, the policy autonomously retrieves, studies, and applies knowledge from long-form references (Study→Reason→Exercise), then improves via an RL loop with a judge scoring proofs.

Benchmark results shown in the paper: Self-Learning RL lifts ID-Book from 39.0 to 65.5, reaches 85.2 on OOD-Book and 86.7 on OOD-Subject, far above both the base model and No-Book RL, with overall proof accuracy rising from 51.5% to 79.5%.

Related event: BookNavigator: RL Framework Lets LLMs Self-Learn from Textbooks(2 posts)→

Original post →

More from Research

Research channel →