Ex-OpenAI/Anthropic pretraining researcher resigns, says labs are gambling on superintelligence
Miles_Brundage · x · 2026-09-10
Jacob (@hilbertspaess), who spent three years doing pretraining research at both OpenAI and Anthropic, resigned from Anthropic, saying neither company is acting responsibly and both are "racing straight to self-improving superintelligence and gambling with our lives."
Former OpenAI researcher Tomasz Korbak amplified the thread, vouching for Jacob as a thoughtful researcher and agreeing with the core claim: neither Anthropic nor OpenAI are on track to solve alignment to a degree sufficient for shipping superintelligence — "we need to slow down." Another public critique of frontier labs' safety commitments from within the safety community.
More from AGI Musings
- From answering to acting: agentic AI's real challenge is governance — AryHHAry · 2026-09-10
- Lab insiders reportedly quote ~10% AI doom publicly but believe 30-90% privately — jeremiecharris · 2026-09-10
- Most non-tech users just want ChatGPT as search, health advice and email drafts — bendee983 · 2026-09-10
- Paul Christiano joins OpenAI board as AI risk hits its 'March 2020' moment — NathanpmYoung · 2026-09-10
- Beff Jezos: 90% sure Anthropic will 'synthesize bioweapons' to spur regulatory capture — AIFlow_ML · 2026-09-10
- A dung beetle and an ant score alike on benchmarks, yet differ vastly in potential — sebkrier · 2026-09-10