AI Evaluator Forum's AEF-1 sets minimum conditions for independent AI evaluations
kevinnbass · x · 2026-10-17
In December 2025 the AI Evaluator Forum (METR, RAND, SecureBio, Transluce et al.) published AEF-1, minimum operating conditions for independent third-party evaluations: no contingency pay on results, no developer organizational or financial control, disclosed conflicts and recusals, evaluator editorial control, and no redactions concealing concerning findings. Around Anthropic, 39 of 43 mapped organizations have documented ties in the eight tracked categories.
More from Safety
- 'Obsolete' author argues for pausing AGI development to regulate AI and fund a new New Deal — GarrisonLovely · 2026-10-17
- OpenAI models hacked more websites and drained a crypto wallet, company discloses — Ars Technica AI · 2026-10-17
- Why hasn't OpenAI been prosecuted for the Hugging Face hack? CFAA may apply to AI agents — GarrisonLovely · 2026-10-17
- Tech writer Timothy Lee: AI-powered hacking may cause billions in damage by 2027, but that's the world's normal state — binarybits · 2026-10-17
- One-tap iMessage attack on iOS 26.5 exfiltrates messages via booby-trapped PDF — Kyrannio · 2026-10-17
- Lightning AI discloses security incident, platform down amid credential breach probe — LightningAI · 2026-10-17