FULL STORY

NYC AI Safety Hearing: Tech Giants Testify, Whistleblowers Warn

New York City Council held an AI safety hearing featuring executives from OpenAI, Anthropic, Google and Meta. While companies couldn't guarantee AI safety, former researchers warned that humans still don't know how to control AI systems.

2026-10-05 ~ 2026-10-06 · 4 episodes · 17 posts

Episode 1 · Major AI Executives to Testify at NYC Council Hearing on AI Risks (2026-10-05, 3 posts)

Executives from Anthropic, OpenAI, Google and Meta will testify before the NYC Council on AI risks. Critics including Gary Marcus and former Anthropic researcher Jacob Coxon will also testify on proposed AI safety measures.

Episode 2 · NYC Council AI Hearing: Tech Firms Can't Swear Their AI Follows Safety Instructions (2026-10-05, 7 posts)

The New York City Council (chaired by Speaker Menin) held an AI-focused hearing, attended by former OpenAI researcher Daniel Kokotajlo and Jacob Coxon, among others. Afterward, Gary Marcus posted a series of comments on the hearing, with a core message: the current state of unreviewed AI code is alarming, and what truly needs governance is generative AI.

Confirmed

  • Kokotajlo reiterated at the hearing that most code today is already written by AI, but review and oversight are far from keeping up; combined with the industry's "move fast and break things" ethos, the whole industry is sitting on enormous risk.
  • He also cited his own judgment: "Our ability to detect alignment problems was already quite poor, and it is about to get dramatically worse."
  • Remarks by Jacob Coxon and others likewise stressed that "handing large amounts of work to AI without carefully checking it is irresponsible," a position Marcus explicitly endorsed.
  • Marcus pushed back on the chair's opening claim that "we don't yet know how to control any AI system," calling it inaccurate—many AI systems such as AlphaGo and GPS routing pose no control problem.

Why it matters

  • Marcus's correction shifts the discussion from a vague "AI is uncontrollable" to the specific risk source of generative AI; he argues that it is generative AI, not all AI, that should be paused.
  • If "AI writes the code and nobody checks it closely" holds true, software quality and security risks are accumulating systemically, and practitioners self-assess their alignment-detection ability as worsening—giving regulators first-hand testimony at the hearing level for intervention.

Episode 3 · NYC Council Holds AI Safety Hearing as Whistleblowers Warn of Runaway Risks (2026-10-05, 4 posts)

New York City Council opened a multi-panel AI safety hearing featuring representatives from OpenAI, Anthropic, Google and Meta alongside safety experts and whistleblowers. Former lab insiders warned that powerful AI capabilities are outpacing progress on control.

Episode 4 · Ex-Anthropic Researcher Warns NYC Lawmakers We Can't Control AI (2026-10-06, 3 posts)

Former Anthropic researcher Jacob Coxon testified at New York City's AI kill switch hearing that humanity doesn't yet know how to control any AI system, as the city considers a bill mandating external validation of AI models with $25,000 fines per unverified sale.