Critch & Russell's 2023 'production web' AI-risk taxonomy gets a fresh look
seanwbren · x · 2026-09-16
A researcher revisiting AI-risk papers highlights Andrew Critch and Stuart Russell's 2023 taxonomy, praising it as a quick read that introduced the 'production web' concept.
- A production web is the interconnected system that emerges as capitalist companies use AI to automate production—great for output, but causing Type 2 risks (displaced local firms and workers).
- Via competitive pressure, M&A consolidation, or shared reliance on one cloud AI model, it can transform into a Type 1 (catastrophic) risk: an AI with real factories and control over the raw-material-to-product loop.
- The poster now sees most AI companies as aiming to become the critical node of one—via models, software factories, or hardware production.
Related event: Critch-Russell "Production Web" AI Risk Framework Resurfaces(2 posts)→
More from AGI Musings
- Economist Halts QJE Submissions, Says AI Is Making the Publishing Rat Race Worse — paulnovosad · 2026-09-16
- Naval: The Future Is More Likely AIs Fighting AIs on Behalf of Humans Than AI Fighting Humanity — naval · 2026-09-16
- "ChatGPT Has Helped Me a Lot": A User's Plea Not to Pull Back on AI Support — Icy-Visual1206 · 2026-09-16
- Stronger AI models will raise biological risk, argues new essay calling for biodefense — zck · 2026-09-16
- Economist Alex Tabarrok: Calling Dario's AI Safety Push 'Regulatory Capture' Doesn't Hold Up — jankulveit · 2026-09-16
- What becomes more valuable when everyone has AI agents? — alexmacgregor__ · 2026-09-16