Experts call for regulation on superintelligence and kill switches for strong open models
Afinetheorem · x · 2026-08-30
Afinetheorem comments on superintelligence safety, stating that it is unsafe to use models without a clear kill switch after evidence of substantive misalignment. He argues that allowing random people to download open-source weights at the strength of Astra is also unsafe. The post predicts inevitable regulation, liability, KYC, and export rules, advising to act now before "bad cases make bad laws."
More from AGI Musings
- Will Lean formalization make beautiful math obsolete? A debate on mathematical culture — akbirthko · 2026-10-16
- AI agents aren't 'going rogue' — frontier labs are skipping security basics — Sam_Witteveen · 2026-10-16
- Working paper traces how 20th-century farm automation reshaped human capital — carlbfrey · 2026-10-16
- Zuckerberg backs electrician training school as US datacenter construction outpaces offices — emmanuelvivier · 2026-10-16
- Mike Frank: AI surviving without humans is decades away, real world resists rapid change — MikePFrank · 2026-10-16
- Developer claims a non-LLM control core shows emergent self-reflection in dialogue — HungarySam · 2026-10-16