The Chimp-Level AI Stage Is the Scariest, Argues Viral Safety Thread
mrjonfinger · x · 2026-09-11
- Continuing the "marmoset brain to planet-sized brain" escalation, the author argues the scariest stage is wildly capable chimp or dumb-human level: impressive execution without broad enough consideration.
- He adds that a planet-sized brain wouldn't need to solve problems inconsiderately, since considering things thoroughly would be easy and cheap for it.
Related event: 'Competent Stupidity' May Be Scarier Than Superintelligence(4 posts)→
More from AGI Musings
- Why Are So Many Mathematicians Resistant to AI-Assisted Proofs? — PreferenceOk5132 · 2026-09-11
- AI Policy Debates Have Become About Tribes, Not Ideas, Argues Sebkrier — sebkrier · 2026-09-11
- If Altman and Amodei both back frontier AI pacing, they should just start pacing — NathanpmYoung · 2026-09-11
- Reddit Thought Experiment: A Real AGI Would Immediately Take Out the Competing Lab — Louay-AI · 2026-09-11
- DeepMind exec: offering cash prizes for math problems was a dumb idea from the start — docmilanfar · 2026-09-11
- The Hodge Conjecture Is Now Being Actively Formalized in Lean — ResultBackground2450 · 2026-09-11