100+ AI experts sign minimum requirements for independent frontier lab evaluations
JacobSteinhardt · x · 2026-09-21
More than 100 leading AI experts have endorsed a set of minimum requirements for the external evaluators that frontier AI labs recently invited in. The AI Eval Forum's conditions: evaluators must be genuinely independent and transparent, span multiple areas of expertise, get employee-level access, and be protected from retaliation for unflattering findings. Jacob Steinhardt (Transluce), chairing the forum, says labs must be accountable for actually meeting these conditions — what they do next is what matters.
More from AGI Musings
- Weighting others by relatedness isn't new: paper models agents learning relational value — xuanalogue · 2026-09-21
- Four motivations of mathematicians explain their split reactions to AI — littmath · 2026-09-21
- Binary Bits: post-AGI per-capita incomes likely cap below 10x US median if humans stay in charge — binarybits · 2026-09-21
- Debate: could post-human AI economies push GDP per capita far past 10x? — binarybits · 2026-09-21
- Gary Marcus defender: he's not anti-AI, just against giving agents the keys — GaryMarcus · 2026-09-21
- Timothy Lee: AI Could Push Per Capita Growth to 3% in the 2030s — binarybits · 2026-09-21