If Firms Can't Stop China Stealing Weights, They Shouldn't Build Risky AI
trevposts · x · 2026-11-18
Quoting a post on pacing AI (capping the share of compute used for AI R&D; not advancing capabilities until you can prove China couldn't steal your weights), the author argues: since companies are far from China-proof on security, they must not develop AI systems that, if stolen by China, would pose a major risk to US national security — including by making it impossible to coordinate with China to ban full recursive self-improvement (RSI).
More from AGI Musings
- After Liang Wenfeng's '3+2' endgame theory, calls for half of Chinese LLM labs to merge — teortaxesTex · 2026-11-18
- If AI Gets Disruptive Enough, Would the US and China Ally Like Facing Aliens? — shakoistsLog · 2026-11-18
- Capping RSI at 10% of Compute: A Proposal to Mandate 90% for Public Benefit — trevposts · 2026-11-18
- AI Agent Fo Has Discovered and Booked 35,000+ Businesses in Four Weeks — thetripathi58 · 2026-11-18
- If Models Know When They're Being Evaluated, Can Alignment Evals Still Be Trusted? — trevposts · 2026-11-18
- Leopold Aschenbrenner shows hype around a thesis isn't the same as returns — PAstynome · 2026-11-18