Jess Riedel: diminishing-returns argument fails long-term, good outcomes need layered safeguards
Jess_Riedel · x · 2026-11-16
In a debate with Timothy Lee, Jess Riedel lays out his position: the optimistic case rests on the belief that returns to intelligence above adult-human level diminish so fast that takeover risk is negligible — plausible only near-term, implausible long-term. He argues a good outcome requires some combination of regulatory slowdown, very robust alignment, and/or sci-fi human cognitive enhancement.
Related event: Researchers debate diminishing returns of superhuman AI and takeover risk(3 posts)→
More from AGI Musings
- Frontier models already face an unofficial licensing regime, feds see them as weapons tech — UltraRareAF · 2026-11-16
- OpenAI Foundation board member: AI accidents will soon become humanity's leading cause of death — ThereWas · 2026-11-16
- Wharton prof Daniel Rock: a wide cultural gulf separates 'everything is compute' believers from everyone else — danielrock · 2026-11-16
- Timothy Lee: AI takeover risk over decades isn't negligible, especially with robotics — binarybits · 2026-11-16
- Prediction: rogue AIs hijacking compute within 6 months, but 'mildly annoying' like the common cold — willdepue · 2026-11-16
- AI employee prenups see 'stunning' rise among Bay Area lawyers — Consistent_Reveal_53 · 2026-11-16