100+ Experts Sign Letter Demanding Five Minimum Standards for Credible Embedded AI Evaluations
random_walker · x · 2026-09-18
A public letter signed by 100+ researchers, including Arvind Narayanan (randomwalker), calls on frontier AI companies to make embedded third-party evaluations credible. While welcoming companies' openness to embedded evaluators for assessing escalating AI capabilities and risks, the letter argues such evaluations must have scientific objectivity, transparency, independence, and robust protections against interference.
The letter lays out five minimum requirements, centering on:
- Evaluator independence from the companies being evaluated
- Protection from retaliation
- Real access to systems, real-world harm incidents, and companies' training, deployment, oversight, operational, and safeguard practices
The authors warn that without these guarantees, embedded evaluations risk becoming a formality as AI risks escalate.
More from AGI Musings
- Andreessen: Agents Are Entering Enterprises as Chaos, Just Like PCs and Spreadsheets Did — Dan_Jeffries1 · 2026-11-04
- 1000+ mathematicians sign pledge to shun AI companies and models — Shesawthat · 2026-11-04
- Von Neumann meme: "You don't have to be responsible for the world that you're in" — akbirthko · 2026-11-04
- Joscha Bach on the dream chocolate that stopped being real — Machine Learning Street Talk · 2026-11-04
- François Chollet: modeling brain wiring as an engineering problem constrained by genome size and time — CatAstro_Piyush · 2026-11-04
- Most US Couples Now Meet in a Data Centre, Doubling Office Matches — menhguin · 2026-11-04