Hugging Face co-founder sparks debate on AI labs' profit motives and danger claims
Hugging Face co-founder Thom Wolf opened a discussion on the apparent contradiction of frontier AI labs simultaneously pushing capabilities and warning of AI dangers, clashing with researcher Merve over the labs' motives; other users joined in criticizing the labs' opaque disclosure practices. No consensus emerged, but the thread laid bare a trust deficit around capability races, danger claims, and transparency.
Confirmed
- Wolf laid out five lines of argument for understanding the contradiction, noting the concern is long-standing: Sam Altman wrote in February 2015 that superintelligence "may be the greatest threat to human existence," and Elon Musk made similar remarks in 2014.
- Responding to Merve's claim that AI companies "only care about profit," Wolf countered that profit-seeking companies would not have started as nonprofits or PBCs, citing the paths of OpenAI and Anthropic.
- Merve's core position is that these companies have never truly cared about anything but profit, and rhetoric like "govern after AGI" amounts to double standards.
- User @doomslide attacked the labs by analogy: they wish to be seen as "1930s nuclear companies in a parallel timeline," issuing ever-larger "semi-controlled chain reaction" alarms without telling the public how the explosion is made, with disclosure fully controlled by the companies.
- User 1a3orn added that allowing third-party evaluators into AI companies eases some principal-agent problems but neither advances science nor builds public knowledge; the labs refuse to disclose pretraining data or architecture while claiming extreme danger.
- Another critic said they cannot reconcile Dario Amodei's claim that "AI could kill everyone" with his Dreamforce keynote, questioning how serious these people are; user vikhyatk quipped that if you truly believed your company was building humanity-destroying technology, you would delay rather than proceed.
Why it matters
- The dispute touches the core tension of AI governance: if labs genuinely believe the technology is dangerous, how do capability races and opaque disclosure cohere?
- Wolf's stance as a co-founder of a leading open-source company contrasts with lab insiders, reflecting the trust rift between the open-source camp and frontier labs.
- Whether third-party evaluation can substitute for public training details is becoming a new focus in safety and transparency debates.
2026-09-14 ~ 2026-09-16 · 7 related posts
- Episode 1: Open Philanthropy Accused of Fueling AI Doom Narrative With Over $1 Billion(2026-09-12, 8 posts)
- Episode 2: Anthropic Researcher's Doomsday Claims Alleged as Orchestrated PR Campaign(2026-09-14, 5 posts)
- Episode 3: Hugging Face co-founder sparks debate on AI labs' profit motives and danger claims(2026-09-14, 7 posts)
- Episode 4: Debate Rages Over Whether AI Doom Talk Is Regulatory Capture(2026-09-15, 4 posts)
- Episode 5: Blogger's "Audit" Claims Anthropic Built a Regulatory Capture Machine, METR Independence Disputed Then Rebutted(2026-09-15, 16 posts)
- Episode 6: Amodei Proposes Embedded METR Oversight of Frontier AI, Sparking Independence Backlash(2026-09-15, 12 posts)
- Episode 7: Researcher Answers Dario's Slowdown Call: Responsibility, Not Rationing(2026-09-16, 3 posts)
- Episode 8: Ben Todd blasts OpenAI and Anthropic over "pacing the frontier"(2026-09-16, 2 posts)
- Episode 9: METR's Independence Questioned: Client Capture and Worldview Alignment(2026-09-16, 7 posts)
- Episode 10: METR's $71M Six-Month Funding Surge Draws Transparency Scrutiny(2026-09-17, 9 posts)
- Episode 11: Anthropic's Dario Amodei Calls for Pacing AI Frontier; Musk, Altman and Hassabis Rally(2026-09-17, 6 posts)
Primary sources
- [source] Why build it if it's dangerous? Mapping the five arguments behind Dario, Sam, and Elon — Thom_Wolf · 2026-09-14
- [source] Merve slams AI labs' doomer-profit doubletalk: safety fearmongering just proves their value — mervenoyann · 2026-09-15
- [source] Hugging Face cofounder pushes back on claim AI labs care only about profit — Thom_Wolf · 2026-09-15
- Thom Wolf clashes with researcher over whether AI labs are only profit-driven — mervenoyann · 2026-09-15
- Critics Slam AI Firms for Hyping Danger While Disclosing Zero Technical Detail — 1a3orn · 2026-09-16
- Third-Party AI Evals Don't Fix Secrecy, Argues Researcher 1a3orn — 1a3orn · 2026-09-16
- Anthropic slammed for doom talk while keynoting Dreamforce — StewartalsopIII · 2026-09-16