100+ Researchers Set Minimum Conditions for Independent AI Evaluator Access
Miles_Brundage · x · 2026-09-18
More than 100 AI researchers and experts, including AVERI, have endorsed a set of minimum requirements for embedded external AI evaluation, responding to labs' recent calls for independent oversight.
- Meaningful independence: no conflicts of interest between labs and evaluators
- Strong access: employee-level system access guaranteed
- Transparency and editorial control: evaluators decide what to publish
- Protections against retaliation for unfavorable findings
- Diversity of perspectives and competencies
The post argues voluntary arrangements alone won't produce credible evaluation — these principles need to be embedded in policy rather than ad hoc one-off agreements, and labs must be accountable for meeting them so the public can trust the process.
More from Companies & People
- Acquaintance Recalls Coxon Was 'Lost' in 2022 Before Joining Pretraining Team — NathanpmYoung · 2026-09-19
- AIxBio Hack brings together OpenAI, Nvidia and wilbe_science — mmbronstein · 2026-09-19
- Disney hires former Character.AI CEO Karandeep Anand as its first CTO — 12exyz · 2026-09-19
- Robot startup's career fair line tops 300 students, outdrawing Google and Amazon — MatthewChang · 2026-09-19
- Decagon Dialogues conference in SF Oct 1 with Cognition CEO and PayPal execs — kimberlywtan · 2026-09-19
- NVIDIA x Nebius Global AI Hackathon offers $50K+ prizes, $20K grand prize — demian_ai · 2026-09-19