Researcher who did pretraining at OpenAI and Anthropic resigns: both racing to self-improving superintelligence

AccBalanced · x · 2026-09-09

Jacob, who spent three years doing pretraining research at both OpenAI and Anthropic, announced his resignation from Anthropic, writing: "Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives."

Safety-policy figures like Nathan Calvin amplified the thread as "extremely powerful and urgent," sparking renewed debate about whether frontier labs are living up to their safety commitments.

Related event: Anthropic researcher resigns over safety, warns over 10% chance AI wipes out humanity(72 posts)→

Original post →

More from AGI Musings

AGI Musings channel →