AI Evaluator Forum releases AEF-1, a baseline standard for independent third-party AI evals
sayashk · x · 2026-09-15
The AI Evaluator Forum (AEF) released AEF-1, its first standard defining Minimum Operating Conditions for Independent Third-Party AI Evaluations.
The standard covers five principles: sufficient access and resources, minimized conflicts of interest, analytic autonomy, transparent methods and results, and protection of sensitive information. Evaluators demonstrate compliance by completing and publishing a checklist alongside results, documenting any unmet conditions. AEF argues no single evaluator can oversee frontier AI alone and that adoption by frontier developers is essential for the standard to matter.
More from Safety
- Cryptographer Matthew Green: Anthropic's agent worm framing is unhelpful, we need a simulated one to know — matthew_d_green · 2026-10-30
- macOS update silently re-adds eMudhra root certs users had removed — steipete · 2026-10-30
- Akamai: Online Scams Double to 6.4M, Overtake Phishing as Attack Windows Shrink to 22 Days — shashib · 2026-10-30
- Anthropic paper: 0.1% pretraining poison plants RCE backdoor in 4B CLI agent — omarsar0 · 2026-10-30
- Cryptographer Matthew Green slams Anthropic's 'model escape' framing of agent worm research — matthew_d_green · 2026-10-30
- Pope Leo calls to 'disarm' AI and urges UN to ban lethal autonomous weapons — The Verge AI · 2026-10-30