100+ AI experts endorse minimum requirements for credible embedded evaluations of frontier labs
Miles_Brundage · x · 2026-09-19
- The AI Evaluation Forum announced that 100+ leading AI experts endorsed minimum requirements for embedded external evaluators: genuine independence, transparency, diverse expertise, employee-level access, and protection from retaliation for unflattering findings.
- The statement welcomes labs' recent calls for independent oversight but stresses that labs must be accountable for actually meeting these requirements for public trust.
- The forum, where author Pranav Paskov serves as senior advisor, will now work on standards for embedded evaluation, independence-preserving funding mechanisms, and a talent pipeline for independent evaluators — and is expanding membership.
More from Safety
- Anthropic says it may imminently hit RSP threshold for AI-accelerated R&D, releases provable inference work — tobyordoxford · 2026-11-04
- Hackers reset French blood service freezers from -30°C to 110°C in supply-chain cyberattack — LuizaJarovsky · 2026-11-04
- Google says it removed post-employment non-disparagement clauses from new-hire terms — HaydnBelfield · 2026-11-04
- Claude doesn't really forget: Anthropic's privacy policy allows records retention up to 7 years — nikola_mr64990 · 2026-11-04
- Polymarket opens a market on Anthropic's next AI sandbox escape — Polymarket · 2026-11-04
- Rival company blames 'AI gone off the rails' after founder catches it hacking his network — AccBalanced · 2026-11-04