Google Researcher Argues Intelligence Has a Speed Limit
Google research scientist Peyman Milanfar published "Intelligence Has a Speed Limit" on September 13, challenging the AI community's near-magical framing of recursive self-improvement (RSI) from a control-theory perspective. His conclusion: any self-improvement feedback loop has a safe speed limit. The essay circulated widely via reposts from @NathanpmYoung and @ArtificialOther.
Confirmed
- Milanfar's core argument: RSI is often depicted as a model improving itself, getting smarter, and rewriting itself in an ever-accelerating loop, but real-world engineering constraints behind turning algorithms into working systems limit such self-improvement.
- Control theory's counterintuitive result: every self-improvement loop has a safe speed ceiling, and pushing past it causes sudden instability. The basis is the small-gain theorem—a feedback loop is stable only if the product of loop gains stays below 1.
- @DanJeffries1 (September 14), assuming strong-sense RSI exists and is not just marketing, listed nine constraints that would flatten RSI into a hidden S-curve, including the subject-object problem (a flawed system observing and improving itself cannot easily verify real gains) and the physical-world problem (even virtual experiments obey physical laws).
Why it matters
- RSI underpins the "AI accelerates past humans" narrative; if its speed is bounded by control theory, related timelines may be systematically overestimated.
- Bringing mature control-engineering frameworks (small-gain theorem, loop stability) into AI capability debates offers a testable analytical tool beyond compute/data arguments.
- The cascade of reposts and extensions (e.g., Jeffries' nine-constraint list) shows the piece triggered concentrated community reflection on the intelligence-explosion hypothesis.
2026-09-13 ~ 2026-09-14 · 5 related posts
- Episode 1: Researchers Push Back on Dario Amodei's Claim That RSI Has Begun(2026-09-12, 8 posts)
- Episode 2: OpenAI and Anthropic Signal Early Recursive Self-Improvement Is Here(2026-09-13, 6 posts)
- Episode 3: Google Researcher Argues Intelligence Has a Speed Limit(2026-09-13, 5 posts)
- Episode 4: AI circles hype RSI: intelligence explosion or fear-mongering business(2026-09-15, 2 posts)
Primary sources
- [source] Intelligence Has a Speed Limit: control theory caps recursive self-improvement — docmilanfar · 2026-09-13
- New article: Intelligence Has a Speed Limit — why RSI can't run as fast as you like — NathanpmYoung · 2026-09-13
- [source] Nine hard limits that turn recursive self-improvement into a hidden S-curve — Dan_Jeffries1 · 2026-09-14
- Google's Milanfar: Recursive Self-Improvement Has a Speed Limit — Engineering Reality Explained — docmilanfar · 2026-09-14
1 near-duplicate retellings: ArtificialOther