Schmidhuber points to his 2015 paper as the origin of recurrent depth and chain-of-thought
SchmidhuberAI · x · 2026-09-03
Asked who the OG of recurrent depth is and which founding papers were forgotten, Schmidhuber pointed to his 2015 paper 'On Learning to Think'.
He explains it went beyond the inefficient millisecond-by-millisecond planning of his 1990 neural world models, addressing planning and reasoning in abstract concept spaces: the controller C acts as an RL prompt engineer that learns to create a chain of thought, querying its world model for abstract reasoning to speed up RL. The prompts are internally self-invented vector sequences that need not represent natural language.
Related event: Schmidhuber Claims OpenAI's Recurrent Depth Traces Back to His 2015 Paper(3 posts)→
More from Research
- Distillation debate: RL, not distilling from sol, likely explains the model's gains — JoshPurtell · 2026-09-03
- Fixing Ideogram 4's Banner and Boosting Prompt Adherence by Fine-Tuning the Text Encoder — mrjackspade · 2026-09-03
- William Tunstall-Pedoe: The 'Trust Ceiling' — Trillions In Value Stuck Behind Unreliable AI — williamtp · 2026-09-03
- TDmol uses 2D molecules as a bridge: text guidance boosts 3D structure similarity by 41% — bravo_abad · 2026-09-03
- Researchers turn to DSRL to improve BC diffusion policies via latent-space RL — DominiqueCAPaul · 2026-09-03
- Dev scrapes 5.94B TikTok videos and 3.23B profiles in 3 weeks, uploads dataset to Hugging Face — DataShack · 2026-09-03