The Pros and Cons of Smoothly Scaling AI Capabilities
RyanGreenblatt · x · 2026-07-11
He argues that the advantage of a "Plan A" is that capability improvements remain steady rather than spiking, providing an opportunity to discover and fix issues at each stage. Another benefit is that humans can research and iterate at a given capability level for years before truly delegating decisions to AI.
However, he stresses that this doesn't guarantee safety: even after years of researching AI alignment, intelligence, and epistemological properties, relying on AI could still be highly dangerous. A faster capability leap would only exacerbate the situation.
More from AGI Musings
- Anthropic's S-1 Shows $6.6M Revenue Per Employee as AI Agents Log 6x Human Hours — jacalulu · 2026-10-26
- Ben Recht: The world needs a truly open language model, and it's easier to build than you think — beenwrekt · 2026-10-26
- Which jobs fall to AI first? The rule: any layer whose rules can be written as code — FinanceYF5 · 2026-10-26
- Anthropic S-1: expert-level AI 'within a few years', 90% of code written by Claude — kimmonismus · 2026-10-26
- The identity crisis in software engineering: multiagent systems demand a new problem set — rakyll · 2026-10-26
- Frontier LLMs negotiate contracts poorly and frequently renege for selfish gain, study finds — xuanalogue · 2026-10-26