100+ AI Experts Sign Public Letter Setting Minimum Conditions for Embedded Evaluators
natolambert · x · 2026-09-18
The AI Evaluator Forum published a public letter endorsed by 100+ AI experts responding to frontier labs' calls for embedded third-party evaluators. Minimum conditions include: evaluators must be genuinely independent (no ownership, major commercial ties, or contingent payment from labs), span multiple risk areas with diverse expertise, be transparent about methods and access, and receive employee-level access plus protection from retaliation. Signatory Nat Lambert notes the biggest bottleneck is finding people with both technical skill and true independence.
More from AGI Musings
- François Chollet: modeling brain wiring as an engineering problem constrained by genome size and time — CatAstro_Piyush · 2026-11-04
- Most US Couples Now Meet in a Data Centre, Doubling Office Matches — menhguin · 2026-11-04
- Sam Altman teases next goal: 'closer to this milestone than I expected' — ChrisGPT · 2026-11-04
- Indie researcher open-sources 10 years of math work: 146k files, AI-accelerated over 3 years — HamOnWhy · 2026-11-04
- RLHF's scalar reward hides a 2,450-year-old problem: helpfulness and harmlessness are opposing forces — vasilisvj · 2026-11-04
- Gary Marcus: 'fleecing the public with AI fantasies just got harder' as AI stocks drop — GaryMarcus · 2026-11-04