RL veteran Szepesvári models AI risk by swapping 'AI' for 'a human'
CsabaSzepesvari · x · 2026-09-14
Csaba Szepesvári discusses how to think about AI risk by substituting "AI" with "a human" or "a powerful organization," since human intelligence is the only pluripotent technology we have centuries of guardrail experience with (education, institutions, laws). He fails to see how a single very intelligent person poses existential risk; an army of cheap amoral ones raises the odds, but the risks he sees are mostly non-existential — and in that scenario a human is still in charge.
More from AGI Musings
- AI isn't eliminating developers, it's changing their roles, argues analyst — DavidLinthicum · 2026-10-30
- Goldman Sachs says AI will eliminate nearly 15 million jobs — saibharadwaj · 2026-10-30
- Stripe spends 1% of OpEx on tokens — bull case for digital labor — zephyr_z9 · 2026-10-30
- Amazon blocks shopping agents, but these 11 retailers still welcome them — thisiskp_ · 2026-10-30
- Lab insiders know alignment is unsolvable but can't say it until the Overton window shifts — danfaggella · 2026-10-30
- ML veteran Andriy Burkov calls 'money won't matter post-superintelligence' nonsense — burkov · 2026-10-30