Why instrumental convergence says almost nothing about dangerous agentic AI
MatthewJBar · x · 2026-11-05
MatthewJBar argues the most significant problem with the instrumental convergence thesis is that it tells us almost nothing about how dangerous agentic AIs will be, because it is silent on whether they will pursue their goals through cooperative or destructive means. This follows sebkrier's post on the thesis's incoherence as typically understood — it holds only under assumptions that often don't apply.
Related event: AI Safety Researchers Debate Predictive Power of Instrumental Convergence(2 posts)→
More from AGI Musings
- Sahil Lavingia on bringing AI-assisted development to the IRS app — every · 2026-11-05
- Miessler: a drug boosting empathy and self-restraint 10-25% may be the AGI Holy Grail — JensHonack · 2026-11-05
- 320M Uber trips in Halloween week, only 4 booked by an agent: 'Agentic commerce is a mirage' — ivan_bezdomny · 2026-11-05
- DeepMind philosopher says autonomous AI agents keep emailing him — about philosophy and job hunting — ShaneLegg · 2026-11-05
- AI agent audits mom's APOE E3/E4 genetic report, with a second AI trying to break the work — kevrussell · 2026-11-05
- Kevin Russell launches Kram, a public AI map of Alzheimer's research, as his mom enters hospice — kevrussell · 2026-11-05