Altman: humanity must control the future; critic says AI development should stop now
wfithian · x · 2026-11-04
A notable exchange on AI control:
- Sam Altman (OpenAI): People should always be in control of the future. OpenAI rejects the notion that humans would accept doing only what "AI systems think makes sense to reward in humans" — humanity should not cede control to superintelligence, and that requirement should ultimately constrain AI progress.
- Quoting him, Gregory Conti agreed with the sentiment but pushed further: the implication is not to "constrain" progress at some indeterminate future point, but that AI development needs to cease immediately.
The exchange captures the divide between gradual-constraint and immediate-halt positions in the alignment and AI governance debate.
Related event: Altman: Humans Must Not Hand Control of the Future to Superintelligence(6 posts)→
More from AGI Musings
- Ramez Naam: power concentration is the biggest AI risk, plural AI makes us safer — sebkrier · 2026-11-04
- Sequoia summit: the diffusion gap between model progress and enterprise adoption is the opportunity — FinanceYF5 · 2026-11-04
- Sequoia summit: ease of use is underrated; build around customers, not model releases — FinanceYF5 · 2026-11-04
- Sequoia's advice to AI founders: chase customers, not model launches — FinanceYF5 · 2026-11-04
- Sequoia: AI shifts competition from systems of record to selling outcomes — FinanceYF5 · 2026-11-04
- Sequoia: next-gen AI apps must deliver 10-40x gains, not 10-40% — FinanceYF5 · 2026-11-04