Using Market Mechanisms to Contain Runaway AGI
AndrewCritchPhD · x · 2026-07-11
The author proposes a concept called Plan M: similar to Plan A, but relying more on market mechanisms rather than centralized government control to drive AI development and prevent runaway RSI loops.
Core Concepts
- Enterprise clients should strictly demand that AI cannot lie, cheat, steal, or harm humans, keeping AI constrained by client requirements throughout the development cycle.
- Individual consumers should demand that AI cannot brainwash them, or at least require the ability to turn off such features.
- Supply-side providers (chips, power, real estate, and financial liquidity) should not be entirely squeezed out of negotiations by fully mechanized entities.
- Developers and civil society should demand high transparency in global AI development and data center management, ensuring that AI tech has built-in kill switches or vulnerabilities to be shut down by legitimate victims.
Author's Take
The author believes that "shut-off capability/vulnerability" is crucial. If anyone can run a runaway RSI loop without adequate control, the catastrophic risk is extremely high.
While acknowledging that governments and treaties might still need to be involved, the author argues against over-relying on aggressive government enforcement like Plan A. Instead, Plan M aims to achieve similar goals through market pressure and social contracts.
More from AGI Musings
- 'AGI is here' vs reality: AI labs still ship some of the jankiest desktop apps ever — MilesCranmer · 2026-09-11
- Misquoted: Anthropic Staff Warned of Double-Digit Extinction Risk by 2030, Not Dismissed It — davidmanheim · 2026-09-11
- Economist Ben Moll: You Can Model Anthropic's 15% AI GDP Growth, But It Won't Happen — sebkrier · 2026-09-11
- Cohere Labs launches interactive tool mapping which tasks of 178 occupations AI can automate — Cohere_Labs · 2026-09-11
- AI researcher on SkyNews flags concerns over inequality, power and criminal misuse — schwarzjn_ · 2026-09-11
- VC compares AI doom rhetoric to pandemic-era fear messaging — StewartalsopIII · 2026-09-11