Why build it if it's dangerous? Mapping the five arguments behind Dario, Sam, and Elon
Thom_Wolf · x · 2026-09-14
Thom Wolf maps out the main arguments behind the apparent contradiction of frontier AI leaders pushing capabilities while warning of existential danger, noting these figures have voiced concern for over a decade: Sam wrote in Feb 2015 that superhuman AI is "probably the greatest threat to the continued existence of humanity," Elon said "we are summoning the demon" at MIT in 2014, and Dario authored "Concrete Problems in AI Safety" in 2016.
The five rationales covered:
- Build to study safety — "you can't learn airplane safety from paper airplanes"; real capability is needed to surface real failure modes
- Better us than them — ensure safety-aware actors hold the expertise, capital, and compute; this also underpins the "outrun China" geopolitical logic
- Move earlier to avoid a bigger shock — gradual progress beats sudden disruption (thread truncated at this point)
More from AGI Musings
- UBI and discretionary income: what happens to middle-class lifestyles? — theearthcrosser · 2026-10-31
- One year later: is MIT's claim that 95% of AI pilots fail actually true? — killboy123 · 2026-10-31
- Nat Lambert: Open models could be what holds the AI ecosystem together — natolambert · 2026-10-31
- Kai-Fu Lee's 'AI Native' ships Nov 3 with endorsement from Satya Nadella — kaifulee · 2026-10-31
- Half-Life writer Chet Faliszek argues AI shortcuts erase the intentionality behind game craft — slhamlet · 2026-10-31
- Companies that replaced engineers with AI are rehiring seniors at a premium — DavidLinthicum · 2026-10-31