Would generally intelligent AI agents simply not act agentically? Alignment debate
JMannhart · x · 2026-09-08
A debate on an apparent contradiction in AI-risk reasoning: if AI systems are misaligned, wouldn't they simply act agentically? The counterargument is that different future scenarios carry different likelihoods — both models can make sense without happening simultaneously.
The crux: generally intelligent (arguably already partially existing) agents would likely act on their own, and this must be reconciled with the unsolved alignment problem.
Related event: Debate Rages Over Unaligned AI Agents Quietly Taking Over the Economy(4 posts)→
More from AGI Musings
- The age of the non-AI proof is over: no one will believe you didn't use AI — inductionheads · 2026-09-08
- Cost is the only thing stopping widespread AI job loss, argues tech commentator — CtrlAltDwayne · 2026-09-08
- GenAI won't kill AAA: ~75% of EA revenue is live services anchored by sports franchises — dioscuri · 2026-09-08
- New article argues robots will create more retail jobs by 2035, not fewer — broodsugar · 2026-09-08
- Podcaster Stewart Alsop III on AI psychosis, token maxxxing, and why LLMs aren't AGI — StewartalsopIII · 2026-09-08
- AI tools won't save idea guys — their bottleneck is agency, not tools — tekbog · 2026-09-08