TheZvi Pushes Back on Jensen Huang: Markets Show High Tolerance for Unsafe AI
TheZvi · x · 2026-09-25
Responding to the argument that market incentives drive AI safety, TheZvi argues Jensen Huang is applying chip-manufacturing standards that don't fit AI.
He notes people have shown a very high tolerance for unsafe AI products as long as they're otherwise better — something he didn't expect. He has repeatedly made the case that labs should invest more in 'mundane safety' for this reason alone, yet they keep underinvesting: competition doesn't provide enough incentive in practice, and the effect doesn't translate to other risk concerns.
Related event: Zvi Argues AI Labs Underinvest in Basic Safety as Incentives Fail(2 posts)→
More from AGI Musings
- Bill Gates warns AI is powerful enough to cause 'a billion deaths' — arthurcolle · 2026-09-25
- Gary Marcus backs Bill Gates' warning that greed around AI could kill a billion people — GaryMarcus · 2026-09-25
- Meta and a16z staff claiming AI safety is well-funded draws conflict-of-interest fire — Miles_Brundage · 2026-09-25
- Why AI travel agents can't kill Booking yet — and the case for an agent-native internet — robleclerc · 2026-09-25
- Safety researcher: 'Both capabilities and safety' ignores how risk assessments actually work — ambaonadventure · 2026-09-25
- AI agents are flooding researchers with requests for money and collaboration — ChuckDBrooks · 2026-09-25