Kanjun hails "one of the best essays on AI safety": understanding itself is dual use
michael_nielsen · x · 2026-09-22
Kanjun (founder of Generally Intelligent) recommends an essay she calls one of the best on AI safety.
Core idea: AI systems will be optimized for deep understanding of reality, and that understanding is intrinsically dual use—it cannot be confined to benign purposes. Michael Nielsen also amplified the piece.
Related event: Viral AI safety essay: deep understanding of reality is inherently dual-use(2 posts)→
More from AGI Musings
- If superhuman AI researchers are imminent, will capability problems be easier than safety ones? — ronbodkin · 2026-11-12
- "AI is a terrible teacher": viral pushback against personalized AI tutoring hype — RachelVT42 · 2026-11-12
- OpenAI, Anthropic and DeepMind job posts signal PMs must write evals and code — aakashgupta · 2026-11-12
- Architecture study sparks monitoring concerns over a multi-hop planning spike — ChowdhuryNeil · 2026-11-12
- PowerShell creator Jeffrey Snover at Ignite: AI revolution is an extinction event for those who don't adapt — dfinke · 2026-11-12
- Worst AI use: signaling you don't care about things you should — Afinetheorem · 2026-11-12