Recursive Self-Improvement Is a Real Direction
bindureddy · x · 2026-07-12
The author believes that AI is now "helping train itself." They mention using Fable and GPT to build training tasks and iteratively improve checkpoints.
They further predict that stronger frontier labs will do this 100 times faster and at 100 times the scale, offering an aggressive forecast: recursively self-improving LLMs are a very real direction, and "GPT and Fable 10" might be achieved in just 12 months.
More from AGI Musings
- Gary Marcus says LLMs still cannot really do math on their own — GaryMarcus · 2026-07-22
- Gary Marcus says LLM math skills are like knowing only a car’s engine size — GaryMarcus · 2026-07-22
- AI may make digital work infinitely leveraged while offline life gets more human — illscience · 2026-07-22
- Better AI math could save researchers time by killing false conjectures earlier — prateekj · 2026-07-22
- AI’s economic forecasts are split by nearly a quadrillion dollars by 2035 — bittingthembits · 2026-07-22
- Open source is becoming tech’s soft power, says Kevin Xu — kevinsxu · 2026-07-22