Prof Yoav Artzi: universities doing AI evals risk losing lab funding and face liability
yoavartzi · x · 2026-09-17
Responding to a discussion with Chris Manning about independent AI evals, Yoav Artzi argues universities face two structural obstacles:
- Conflict of interest: evaluators who anger labs risk losing funding, cooperation, or even their PhD students' prospects.
- Who does the work: underpaid students who traded income for education shouldn't run evals — it needs stable, well-paid staff research scientists. And if an eval involves cheating or malpractice, liability questions (does the university answer?) make legal teams balk.
Related event: Scholars debate who should run independent AI model evaluations(3 posts)→
More from Companies & People
- Ex-Microsoft engineer recalls Windows 8 meetings: note app idea met with abuse, then he quit — lmoroney · 2026-09-17
- MSK Partners With OpenEvidence, Binging OncoKB Precision Oncology Data to Doctors — benxneo · 2026-09-17
- Manus Launches Global "Learn AI with Manus" Partner Program, Starting with Singapore — parker_lyman · 2026-09-17
- SpaceXAI Marketer to Demo Running End-to-End Campaigns with Grok Bots — chaitu · 2026-09-17
- Warning: integrating with frontier labs' chat products hands over your user data — Scobleizer · 2026-09-17
- Tweeting his way into METR: SB 1047 sparring partners make peace — austinc3301 · 2026-09-17