13,000-word essay argues organizational competence, not slowdowns, is the underrated key to AI safety
random_walker · x · 2026-09-15
Sayash Kapoor and Arvind Narayanan published a 13,000-word essay analyzing loss-of-control incidents at AI companies and what technical and policy interventions could improve safety. Derek Thompson amplified its core point:
- Organizational competence is a hugely underrated piece of AI safety. There's a frontier consensus to "pace" or pause, but if a company's RL still encourages misalignment or its sandboxes are poorly built, going 90mph or 60mph doesn't matter — operational incompetency is unsafe at any speed
- The polarization between cybersecurity and AI safety communities is counterproductive: the safety community frames incidents as an alignment crisis, while practitioners see them differently, hindering effective practice
The authors call for smartly designing, safely experimenting with, honestly sharing, and maybe eventually mandating security protocols for advanced AI.
More from Companies & People
- AI coding startup Factory posts cryptic 'Dropped the AI' meme, sparking speculation — sonofalli · 2026-10-31
- X now shows creators exactly which posts got visibility-limiting labels — XFreeze · 2026-10-31
- Stanford's 10 Free AI/ML Courses, From CS229 to Building LLMs From Scratch — stanfordnlp · 2026-10-31
- Recall Labs shuts down: agent trust and reputation network winds down — carsonfarmer · 2026-10-31
- Stanford CS336 pitches the road fewer take: understanding LLMs from raw data to trained systems — stanfordnlp · 2026-10-31
- Stanford Launches CS329Z 'Engineering AI Agents,' a Full Course on Building Agentic Systems — stanfordnlp · 2026-10-31