The Chimp-Level AI Stage Is the Scariest, Argues Viral Safety Thread
mrjonfinger · x · 2026-09-11
- Continuing the "marmoset brain to planet-sized brain" escalation, the author argues the scariest stage is wildly capable chimp or dumb-human level: impressive execution without broad enough consideration.
- He adds that a planet-sized brain wouldn't need to solve problems inconsiderately, since considering things thoroughly would be easy and cheap for it.
Related event: Jon Finger: 'Very Capable Stupidity' Is Scarier Than Superintelligence(5 posts)→
More from AGI Musings
- Pedro Domingos mocks NYT claim that superintelligence is already here — pmddomingos · 2026-10-28
- What if millions of AIs' combined incentives create irreversible outcomes? — PierceLilholt · 2026-10-28
- Coding matters less than problem-finding: the shift from code engineers to product engineers — CtrlAltDwayne · 2026-10-28
- Rachel Thomas points to classic paper on articulating the value of not building tech — math_rachel · 2026-10-28
- Hypothetical $2T Anthropic IPO framed as channeling $100B+ a year into the real economy — sanjaykalra · 2026-10-28
- Biotech CEO: drug discovery will lag in the AI revolution, not lead it — vaibhavbetter · 2026-10-28