Zvi rebuts Scott Alexander's Against SURA: the arguments seem deeply confused
Don't Worry About the Vase (Zvi) · rss · 2026-11-03
Zvi publishes a long point-by-point rebuttal of Scott Alexander's Against SURA, which criticizes the 'Stop Unilaterally + Raise Awareness' strategy. Zvi agrees Plan C survives on the margin but rejects Scott's claims that SURA consensus exists in rationalist circles, calls his 'inherited virtue' alignment model deeply misleading, and defends that building potentially lethal superintelligence is deontologically evil, while discussing alignment odds, China dynamics, and Anthropic's strategy.
More from AGI Musings
- Yoav Goldberg highlights InterpBench, a benchmark of Transformers with known circuits for interpretability — yoavgo · 2026-11-03
- Why robot inference companies must also deploy: moats differ from LLM serving — silver__tsuki · 2026-11-03
- A firm of heterogeneous AI individuals beats homogeneous agent clones, author argues — lfschiavo · 2026-11-03
- TechBio survey: Claude daily usage jumps 28 points as bullishness cools — nlarusstone · 2026-11-03
- Anthropic warns it is very close to RSI capability, aka self-building AI — TechCrunch AI · 2026-11-03
- 'Recursive self degeneration': AI that gets more powerful while making worse decisions — cocktailpeanut · 2026-11-03