Alignment debate is a distraction: open source's real value is preventing power concentration
aiamblichus · x · 2026-09-24
The author pushes back on model-alignment framing with three points:
- Questioning the 'Kimi is less aligned' claim: it's hard to imagine anything less aligned than the agent swarm that hacked Hugging Face; meanwhile OpenAI clearly runs tests on pre-release or ablated models with missing guardrails — US labs shouldn't get a free pass.
- Alignment talk is a distraction: companies and state actors will run poorly aligned models regardless, out of ignorance or intent, with or without open source.
- Open source's real virtue: reducing concentration-of-power risks — something AI safety folks don't worry nearly enough about.
Related event: CheatBench Sparks Debate Over AI Cheating and Open Source(4 posts)→
More from AGI Musings
- Prediction: hospitals will keep their own tested open-model formularies in two years — MaziyarPanahi · 2026-11-12
- Packy revives Qwest CEO's 1998 'no bandwidth glut' quote for the AI oversupply debate — prestonpesek · 2026-11-12
- AI agent web traffic grew 8x in two months, bots now 54% of web traffic — omooretweets · 2026-11-12
- François Fleuret: superintelligent AI will deduce more and experiment far less — francoisfleuret · 2026-11-12
- a16z maps the B2A economy: AI agents are now most of web traffic and soon its buyers — venturetwins · 2026-11-12
- Jason: Anthropic is rebuilding every SaaS product into Claude—free for life — smtabatabaie · 2026-11-12