FULL STORY
AI Whistleblowers Testify at NYC Council Hearing
Former Anthropic and OpenAI researchers testified at a New York City Council hearing on AI risks and external-verification legislation. Jacob Coxon continued his media push on The Daily Show.
2026-10-05 ~ 2026-10-08 · 2 episodes · 29 posts
Episode 1 · NYC Council AI hearing: whistleblowers warn of losing control as city weighs external validation bill (2026-10-05, 22 posts)
The New York City Council held a large-scale AI risk hearing where whistleblowers including former Anthropic researcher Jacob Coxon and former OpenAI researcher Daniel Kokotajlo testified that humanity lacks the means to control AI systems and may lose control entirely on the current path, potentially ending in extinction. Alongside, the Council is weighing a bill that would bar AI models without external validation from being sold locally, with $25,000 fines per violation—potentially making NYC the first US city to mandate pre-market external validation of AI models.
Confirmed
- Coxon said his two biggest concerns are that we currently don't know how to control any AI system and that AI capability gains are accelerating; emergency mechanisms like kill switches alone are insufficient. CNBC and other outlets covered the testimony
- Coxon testified that "on the current path, humanity is more likely to lose control of these AIs, potentially ending in human extinction." Per heyshrutimishra's account, he worked on frontier models at both OpenAI and Anthropic and explained his two reasons for leaving; reporter Steph Palazzolo noted he publicly resigned from Anthropic last month in protest
- Coxon said automated AI research is now the top priority of frontier labs—"this is what they are really racing toward"—and that at his previous job he was in some sense "automating himself" away, noting OpenAI set a 2027-28 milestone for automating AI researchers that may be reached within months. Palazzolo called the hearing "more of a show" but said the whistleblowers' remarks about rapid automation of AI research deserve attention
- Kokotajlo testified that most code is now written by AI but review hasn't kept up, that our ability to detect alignment problems is already quite poor and will worsen soon, and that combined with move-fast industry norms the whole field faces huge risk; Gary Marcus repeatedly amplified these points
- Gary Marcus testified and published excerpts in advance, while correcting the hearing's opening line "we don't yet know how to control any AI system": many AI systems like AlphaGo or GPS routing pose no control problem—the issue is generative AI
- Marcus also relayed that Council Member Alexa Avilés asked tech executives to swear their AI systems would comply with safety instructions—and they could not; he slammed OpenAI's Morgan Dwyer for saying OpenAI "can commit to not releasing models it deems unsafe," calling it "close to perjury"
- The hearing, chaired by Speaker Julie Menin, featured 14 witness panels with safety experts and whistleblowers first; per Annie McDonough's live updates, nearly three hours in it was still on panel 2, with about 30 council members signed up to question tech companies. Miles Brundage, Rosie Campbell and others also testified; OpenAI, Anthropic, Google and Meta all sent representatives
- Menin said she would require companies to explain AI risks and signaled potential legislation; the day before the hearing, Politico reported Sam Altman saying "the world should accept some of the bad the technology brings in exchange for its benefits"
Why it matters
- This is a rare case of AI safety researchers and whistleblowers testifying en masse at the local legislative level, directly advancing NYC's potential status as the first US city requiring pre-market external validation of AI models; the $25,000-per-violation penalty also sets a precedent. Whistleblower testimony on automated AI research, unreviewed AI code, and extinction-level risk provided first-hand internal evidence for the legislation
- Ex-Anthropic researcher Jacob Coxon to testify before NYC lawmakers on new AI safeguards — Polymarket · 2026-10-05
- Gary Marcus to testify at New York City Council hearing on AI risks — GaryMarcus · 2026-10-05
- Anthropic, OpenAI, Google and Meta execs to testify at NYC Council hearing on AI risks — pstAsiatech · 2026-10-05
- Gary Marcus: It's Generative AI We Can't Control, So Pause That Specific Technology — GaryMarcus · 2026-10-05
- Gary Marcus at NYC Council: only generative AI lacks control, pause just that — GaryMarcus · 2026-10-05
- Gary Marcus Agrees: AI-Written Code Goes Unchecked, and That's 'Irresponsible' — GaryMarcus · 2026-10-05
- Gary Marcus flags NYC hearing claim: most code is now AI-written and under-reviewed — GaryMarcus · 2026-10-05
- Kokotajlo: our ability to notice misalignment is poor and set to get much worse — GaryMarcus · 2026-10-05
- NYC Council kicks off AI safeguards hearing with Brundage, Kokotajlo and other researchers testifying — teortaxesTex · 2026-10-05
- NYC Council Holds AI Risk Hearing With OpenAI, Anthropic, Google, Meta and Whistleblowers — steph_palazzolo · 2026-10-05
- NYC bill would fine AI vendors $25K per unvalidated model sale, mandate kill switches — rohanpaul_ai · 2026-10-06
- CNBC covers Jacob Coxon's warning at NYC AI kill-switch hearing — rohanpaul_ai · 2026-10-06
- Tech firms can't testify under oath that their AI obeys safety instructions, says Gary Marcus — GaryMarcus · 2026-10-06
- Gary Marcus calls OpenAI's safety commitment 'close to perjury,' flags Astra problems — GaryMarcus · 2026-10-06
- Ex-Anthropic researcher tells NYC lawmakers: 'We do not know how to control any AI system yet' — Polymarket · 2026-10-06
- NYC Council AI hearing spans 14 witness panels as 30 members question tech companies — Miles_Brundage · 2026-10-06
- NYC Council AI whistleblower panel: Kokotajlo, Coxon warn labs can't control the systems they build — sjgadler · 2026-10-06
- "We don't know how to control any AI system": researcher testifies at NYC Council AI hearing — RebeccaBellan · 2026-10-06
- AI safety whistleblowers including Jacob Coxon testify before NY City Council — shiringhaffary · 2026-10-06
- Ex-Anthropic researcher: OpenAI's 2027-28 automated AI researcher milestone is months away — rohanpaul_ai · 2026-10-06
Episode 2 · Ex-Anthropic researcher warns of AI control loss across media and city council (2026-10-07, 7 posts)
Jacob Coxon, a former researcher at Anthropic (previously OpenAI) who quit over his belief that AI companies are 'gambling with lives' and gave up a seven-figure salary, has made a string of high-profile appearances: testifying before the New York City Council and appearing on Jon Stewart's The Daily Show. His core message is that loss of control over advanced AI is imminent and that jobs will be displaced by an automated economy, making him a prominent public face of AI safety concerns.
Confirmed
- At the NYC Council hearing, Coxon testified that 'on the current path, humanity is more likely than not to lose control of advanced AI, potentially ending in human extinction'
- He predicted an 'automated AI researcher' emerging around 2027 or 2028
- Per a Reddit discussion, his resignation rationale was that roughly 26% of model R&D is already 'models building models', making recursive self-improvement (RSI) in 2027 a present reality rather than a prediction
- On The Daily Show, he discussed AI-driven job loss, UBI, and whether tech CEOs are building a dystopian future
- He argued that 'in the world these tech companies envision, there will be no jobs' — only dividends from fully autonomous economic production providing universal high income for all real humans; he nonetheless called the exchange 'basically a rhetorical failure' because the audience did not believe the benefits would be distributed fairly
- He previously worked at both OpenAI and Anthropic
Why it matters
- Coxon is one of the few frontier-lab insiders who broke publicly via resignation and then密集appeared in mainstream media and legislative hearings; his testimony may shape local and public debate on AI regulation
- His concrete timeline (automated AI researchers by 2027-28; RSI already underway) sparked community debate over credibility, with @chemistslime among those taking a wait-and-see stance on the impact of such high-profile warnings
- He links AI risk to how post-scarcity gains would be distributed, touching the core controversy over whether UBI-style techno-optimism can convince the public
- Ex-Anthropic Researcher Jacob Coxon: The Future Has No Jobs, Only Universal High Income — kimmonismus · 2026-10-07
- Ex-Anthropic researcher Jacob Coxon tells Jon Stewart: no jobs, but a universal high income — Neurogence · 2026-10-07
- Ex-Anthropic researcher Jacob Coxon joins Jon Stewart to discuss AI job losses and UBI — AlexTensor · 2026-10-07
- Ex-OpenAI/Anthropic researcher: automated AI researcher by 2027-28, humans far out of the loop — rohanpaul_ai · 2026-10-07
- Former OpenAI and Anthropic researchers tell NYC Council humanity likely to lose control of advanced AI — fortune · 2026-10-07
- Ex-OpenAI/Anthropic Researcher Warns of AI Dangers on The Daily Show and NYC Council — chemist_slime · 2026-10-08
- Ex-Anthropic's Jacob Coxon quit a seven-figure salary over recursive self-improvement fears — cen6wkf · 2026-10-08