Scholars debate who should run independent AI model evaluations
Yoav Artzi and others debate the incentives of AI evaluation bodies, arguing universities face funding conflicts but are cleaner than lab-affiliated nonprofits, and that evaluations should be done by stable, well-paid career researchers rather than low-paid students.
2026-09-17 ~ 2026-09-17 · 3 related posts
- Episode 1: METR President Responds to Critics, Reaffirms AI Risk Evaluation Mission(2026-09-17, 6 posts)
- Episode 2: AI Safety Evaluator METR Discloses Funders and Conflict-of-Interest Policy(2026-09-17, 3 posts)
- Episode 3: Scholars debate who should run independent AI model evaluations(2026-09-17, 3 posts)
- Debate: universities face fewer incentive conflicts than lab-connected nonprofits for AI evals — tallinzen · 2026-09-17
- AI evals shouldn't be done by underpaid students but by stable, tenured research staff — tallinzen · 2026-09-17
- Prof Yoav Artzi: universities doing AI evals risk losing lab funding and face liability — yoavartzi · 2026-09-17