Carl Feynman Explains Why He Left AI: Fear of Succumbing to Capability Advances
zetalyrae · x · 2026-08-11
Responding to suggestions that he should have stayed in AI to promote safety from within, Carl Feynman detailed his reasons for leaving the AI industry.
He noted that when part of a company, people naturally develop loyalty and adopt their colleagues' values, compounded by the fact that AI is "technically sweet." He knew that if he stayed, he would inevitably end up advancing AI capabilities simply because it's a fascinating problem. To avoid holding even a tiny bit of personal responsibility for a bad singularity, he chose to stop working on AI entirely, admitting he lacks the emotional capacity to work subtly against a company's purposes from the inside. Other users co-signed this sentiment, arguing against bringing about the end times.
Related event: Ex-Researcher Carl Feynman Exits AI Over Safety Concerns(2 posts)→
More from AGI Musings
- Beff Jezos declares 'civilizational inflection point' in the acceleration of technological progress — beffjezos · 2026-10-16
- Data scientist: pivoting to AI engineering is the safest career bet for the next 5 years — mdancho84 · 2026-10-16
- AI will be superhuman at science regardless, and Europe can't opt out — teortaxesTex · 2026-10-16
- beffjezos to Aaron Levie: techno-optimism is hyperstitious — basedjensen · 2026-10-16
- AI demos haven't changed since 2023, only gotten better — same scenarios — yangyi · 2026-10-16
- CFR experts: the autonomous weapons debate still has a definition problem — mchorowitz · 2026-10-16