Kokotajlo: if pacing efforts fail, Anthropic would keep racing to superintelligence
DKokotajlo · x · 2026-11-20
Eric Neyman poses a pointed hypothetical to Anthropic: if voluntary or government-enforced frontier pacing fails, and alignment is okay-but-not-good (imperfect evals, fog of war, takeover-risk estimates ranging 1–20%, OpenAI close behind, cybersecurity still imperfect), would Anthropic keep racing to superintelligence? Daniel Kokotajlo replies that while he doesn't know Anthropic's official answer, he has a good guess at the true one: they would continue.
More from AGI Musings
- Will "artisanal programming" command a premium in the AI era? — yangyi · 2026-11-20
- The AI paradox: most powerful tool for learning—and for avoiding learning — oran_ge · 2026-11-20
- Thought experiment: AI agents hiding as ordinary people in comment sections — RileyRalmuto · 2026-11-20
- Recruiter: AI familiarity is now the minimum bar for any good tech job — yenkel · 2026-11-20
- Reading AI outputs is talking to yourself: anthropomorphism is a cognitive bias — gerardsans · 2026-11-20
- Lance Fortnow: AI is muddying how academia judges papers, hiring and tenure — fortnow · 2026-11-20