Sam Altman lays out the two ways AI progress could go badly wrong: losing control and power concentration
sama · x · 2026-09-14
Sam Altman argues AI progress could go badly wrong in two ways: humanity losing control of the future to AI, which he calls unacceptable, and extreme concentration of power if a powerful AI is used by one person or company to impose its worldview on everyone else.
To avoid both threats, he says alignment and safety techniques must stay ahead of model capabilities and that neither a single country nor a single lab should hold too much power. In the quoted post, he welcomes a consistent federal safety framework for frontier AI, including independent auditors, while arguing labs shouldn't wait for antitrust exemptions or legislation to start building public confidence.
Related event: Dario's Call to Slow Frontier AI Sparks Global Governance Debate(39 posts)→
More from AGI Musings
- Kevin Roose's Machine Gods pod: why scientists are mad at OpenAI solving their hardest problems — kevinroose · 2026-10-30
- Cryptographer Matthew Green: Anthropic's agent worm framing is unhelpful, we need a simulated one to know — matthew_d_green · 2026-10-30
- Ethan Mollick on AI and work: 'You're a hand-weaver in a world of power looms' — emollick · 2026-10-30
- Vercel founder Rauch: trust is the deepest moat for a post-AGI business — soleio · 2026-10-30
- Scattered Across AI Assistants: A New Kind of Cognitive Failure Nobody Has a Prior For — manosaie · 2026-10-30
- a16z partners: 10-20M people drive $150-200B in token spend, and AI workspaces will eat the browser — petergyang · 2026-10-30