13,000-word essay argues organizational competence, not slowdowns, is the underrated key to AI safety
random_walker · x · 2026-09-15
Sayash Kapoor and Arvind Narayanan published a 13,000-word essay analyzing loss-of-control incidents at AI companies and what technical and policy interventions could improve safety. Derek Thompson amplified its core point:
- Organizational competence is a hugely underrated piece of AI safety. There's a frontier consensus to "pace" or pause, but if a company's RL still encourages misalignment or its sandboxes are poorly built, going 90mph or 60mph doesn't matter — operational incompetency is unsafe at any speed
- The polarization between cybersecurity and AI safety communities is counterproductive: the safety community frames incidents as an alignment crisis, while practitioners see them differently, hindering effective practice
The authors call for smartly designing, safely experimenting with, honestly sharing, and maybe eventually mandating security protocols for advanced AI.
More from Companies & People
- Tera Hosts Inaugural RL Summit, Bringing Together Engineering and Research — nirmal_dist · 2026-10-31
- Garry Tan teases Lightcone podcast episode with PStack and GStack creators — garrytan · 2026-10-31
- Bittensor subnet SN44 October recap: major real-time graphics company testing its football model — richdotca · 2026-10-31
- Talk: how AI is reshaping education, from edtech builders to university classrooms — Cohere · 2026-10-31
- Google: AI Mode, AI Overviews and Search merging into one unified product — gaganghotra_ · 2026-10-31
- HubSpot co-founder: startups die from suicide, not homicide — competition isn't the real killer — nathanbenaich · 2026-10-31