FULL STORY

METR Clarifies Mission Amid AI Evaluator Independence Debate

After METR's president clarified its mission and funding transparency, academics debated whether universities or nonprofits should lead AI model evaluation. The episode grew from a defense into an industry-wide governance discussion.

2026-09-17 ~ 2026-09-18 · 3 episodes · 12 posts

Episode 1 · METR President Responds to Critics, Reaffirms AI Risk Evaluation Mission (2026-09-17, 6 posts)

METR President Chris Painter personally published a post around September 17 responding to recent criticism of the organization and its OpenAI audit, reaffirming METR's mission and positioning. Multiple bloggers (@AndyMasley, @basedjensen, @dhadfieldmenell, @kyliebytes) relayed the piece, and researchers including Talia Ringer shared it in support. The upshot: Painter frames METR as a research organization evaluating AI risks, not a regulator, but questions about its actual access during the OpenAI audit remain unclarified by first-hand sources.

Confirmed

  • Painter stated that since 2022 METR has worked to ensure the public is informed "if AI truly becomes autonomous, incorrigible, or close to out of control," positioning METR as an evaluator of loss-of-control risk rather than a regulator.
  • He noted team members gave up high-paying jobs for AI safety evaluation, and that METR has cooperated with frontier labs including OpenAI since 2022.
  • Context includes Ben Todd joking that "METR's biggest donor is the mysterious TED talk organization."

Unconfirmed

  • @NathanpmYoung relayed claims that METR allegedly received only a 3-day information access period in its OpenAI investigation and was barred from materials outside that window; citing MackenZarnold, he argued Stoller's claim of a "sham investigation" reflects a forced compromise rather than negligence. These details come second-hand and the contract terms remain unverified.

Why it matters

  • METR is one of the few third-party evaluators of dangerous AI capabilities; its independence and actual access directly affect the credibility of frontier-model safety assessments. If access was indeed limited, the public must recalibrate what its reports do and do not cover.

Episode 2 · AI Safety Evaluator METR Discloses Funders and Conflict-of-Interest Policy (2026-09-17, 3 posts)

METR has disclosed its funders, including The Audacious Project and Schmidt Sciences, published its conflict-of-interest policy, and confirmed it refuses donations from frontier AI companies.

Episode 3 · Scholars debate who should run independent AI model evaluations (2026-09-17, 3 posts)

Yoav Artzi and others debate the incentives of AI evaluation bodies, arguing universities face funding conflicts but are cleaner than lab-affiliated nonprofits, and that evaluations should be done by stable, well-paid career researchers rather than low-paid students.