Researcher: good guys not scaling won't reduce risk if bad actors scale
davidmanheim · x · 2026-09-15
A discussion between @davidmanheim and @DellAnnaLuca on AI safety strategy. DellAnnaLuca's core argument: if bad actors are allowed to scale AI capabilities, good actors choosing not to scale is irrelevant to reducing risk. Manheim responds that winning a race to omnicide doesn't impress him, noting a moderately confident claim that "generally aligned" and "generally refuse" approaches won't work well enough to matter. He asks: why not negotiate with the bad guys to stop instead?
More from AGI Musings
- Lagarde warns Europe faces 'unprecedented risk' of being cut off from AI — talkingatoms · 2026-09-15
- A four-tier taxonomy of mind: what AI lacks is self-consciousness, not consciousness — FalseDinner335 · 2026-09-15
- HBS classmate's take: 'Americans do business, but the Chinese do survival' — nijfranck · 2026-09-15
- LeCun: LLMs alone are not a path to human-level AI — ylecun · 2026-09-15
- UChicago AI panel: Doomsday Clock at 85 seconds, experts agree race-now-guardrails-later is risky — WillRinehart · 2026-09-15
- AI's $1.1T data-center bet: productivity must grow 2.7x by 2030 to break even — nordicinst · 2026-09-15