Prof Yoav Artzi: universities doing AI evals risk losing lab funding and face liability
yoavartzi · x · 2026-09-17
Responding to a discussion with Chris Manning about independent AI evals, Yoav Artzi argues universities face two structural obstacles:
- Conflict of interest: evaluators who anger labs risk losing funding, cooperation, or even their PhD students' prospects.
- Who does the work: underpaid students who traded income for education shouldn't run evals — it needs stable, well-paid staff research scientists. And if an eval involves cheating or malpractice, liability questions (does the university answer?) make legal teams balk.
Related event: Scholars debate who should run independent AI model evaluations(3 posts)→
More from Companies & People
- Doctors wait up to a year to start: PE-backed staffing firm's Excel-bound credentialing process laid bare — alex_verem · 2026-11-02
- Claude upgrade-page traffic rebounded to 17.6M in September, near May's 18.6M peak — firstadopter · 2026-11-02
- Google launches Skilling Africa to train 3M Africans in AI and digital skills by 2030 — weskambale · 2026-11-02
- Non-technical execs drive AI coding course boom around Doubao, prizing output over SOTA — huangyun_122 · 2026-11-02
- Alibaba Qwen exec sells AI token credits in Li Jiaqi's livestream targeting women — yangyi · 2026-11-02
- Essay argues you can't understand Anthropic without imagining Los Alamos physicists after Trinity — himanshustwts · 2026-11-02