Kanjun hails "one of the best essays on AI safety": understanding itself is dual use
michael_nielsen · x · 2026-09-22
Kanjun (founder of Generally Intelligent) recommends an essay she calls one of the best on AI safety.
Core idea: AI systems will be optimized for deep understanding of reality, and that understanding is intrinsically dual use—it cannot be confined to benign purposes. Michael Nielsen also amplified the piece.
Related event: Viral AI safety essay: deep understanding of reality is inherently dual-use(2 posts)→
More from AGI Musings
- Physicist Quits Tenure-Track Job for AI Safety: 'They Installed Escalators on All the Mountains' — matthew_d_green · 2026-09-22
- AI x-risk debate reignited: distraction conspiracy or inconvenient truth? — AaronBergman18 · 2026-09-22
- Alex Epstein calls (P)doom 'fake threat analysis' that only manufactures fear — TinfoilTricorn · 2026-09-22
- Ruxandra Teslo: AI anxiety is about losing meaning and agency, not just jobs — anshulkundaje · 2026-09-22
- From Erdős to Millennium Problems: AI math progress is compounding fast — haider1 · 2026-09-22
- More inference than training machines means writing will soon beat reading — GregoryDiamos · 2026-09-22