100+ AI experts set minimum requirements for embedded external evaluators at AI labs
ajeya_cotra · x · 2026-09-19
More than 100 leading AI experts endorsed minimum requirements for AI companies' proposals to embed external evaluators: evaluators must be genuinely independent, transparent, span multiple expertise areas, have employee-level access, and be protected from retaliation.
The group welcomes labs' calls for independent oversight but says labs must be accountable for meeting these requirements for the public to trust the process. Ajeya Cotra, amplifying the post, argues embedded evaluators alone can't yet provide the visibility the public deserves.
More from Safety
- Anthropic says it may imminently hit RSP threshold for AI-accelerated R&D, releases provable inference work — tobyordoxford · 2026-11-04
- Hackers reset French blood service freezers from -30°C to 110°C in supply-chain cyberattack — LuizaJarovsky · 2026-11-04
- Google says it removed post-employment non-disparagement clauses from new-hire terms — HaydnBelfield · 2026-11-04
- Claude doesn't really forget: Anthropic's privacy policy allows records retention up to 7 years — nikola_mr64990 · 2026-11-04
- Polymarket opens a market on Anthropic's next AI sandbox escape — Polymarket · 2026-11-04
- Rival company blames 'AI gone off the rails' after founder catches it hacking his network — AccBalanced · 2026-11-04