Using Market Mechanisms to Contain Runaway AGI
AndrewCritchPhD · x · 2026-07-11
The author proposes a concept called Plan M: similar to Plan A, but relying more on market mechanisms rather than centralized government control to drive AI development and prevent runaway RSI loops.
Core Concepts
- Enterprise clients should strictly demand that AI cannot lie, cheat, steal, or harm humans, keeping AI constrained by client requirements throughout the development cycle.
- Individual consumers should demand that AI cannot brainwash them, or at least require the ability to turn off such features.
- Supply-side providers (chips, power, real estate, and financial liquidity) should not be entirely squeezed out of negotiations by fully mechanized entities.
- Developers and civil society should demand high transparency in global AI development and data center management, ensuring that AI tech has built-in kill switches or vulnerabilities to be shut down by legitimate victims.
Author's Take
The author believes that "shut-off capability/vulnerability" is crucial. If anyone can run a runaway RSI loop without adequate control, the catastrophic risk is extremely high.
While acknowledging that governments and treaties might still need to be involved, the author argues against over-relying on aggressive government enforcement like Plan A. Instead, Plan M aims to achieve similar goals through market pressure and social contracts.
More from AGI Musings
- Claude Code skill uses 10 Markdown rules to make outputs ADHD-friendly — alex_verem · 2026-07-22
- ControlAI CEO says an international ban on superintelligence is needed to avert extinction risk — zetalyrae · 2026-07-22
- Gary Marcus says LLMs still cannot really do math on their own — GaryMarcus · 2026-07-22
- Gary Marcus says LLM math skills are like knowing only a car’s engine size — GaryMarcus · 2026-07-22
- AI may make digital work infinitely leveraged while offline life gets more human — illscience · 2026-07-22
- Better AI math could save researchers time by killing false conjectures earlier — prateekj · 2026-07-22