AI Safety Folks Were Debating Loss of Control and RSI Before NVDA Was a Gaming Company
john__allard · x · 2026-09-09
John Allard pushes back on claims that AI safety people haven't documented their fears: while disagreeing on timelines and risk probabilities is fair, few subcultures have written more in-depth about AI advancement and specific risk scenarios — with probability estimates — than AI safety folks. LessWrong posters were arguing about loss of control and recursive self-improvement back when NVDA was still a gaming company.
Related event: AI Safety Supporters Push Back: X-Risk Concerns Are Well Documented(2 posts)→
More from AGI Musings
- VCs were told AGI leaders believe their tech could cause human extinction — 'VCs won't save humanity' — agstrait · 2026-09-09
- More risk from labs probing how exploitable models are than from models turning evil, author argues — dreamwieber · 2026-09-09
- 500K replicas of OK intelligence scare this AI worker more than a god model — mertdumenci · 2026-09-09
- AI safety testing itself may be the biggest risk? Debate on lab experiments — dreamwieber · 2026-09-09
- Dev argues AGI may come from 500K copies of OK intelligence, not one god model — mertdumenci · 2026-09-09
- tszzl wraps up the debate: grabby aliens and a behind-us great filter — tszzl · 2026-09-09