AI Evaluators Gather for First Time, But Audit Ecosystem Remains Fragmented

A San Francisco dinner co-hosted with Snorkel AI brought together evaluation leads from OpenAI, Meta, Google DeepMind, NIST, METR and others for the first time, yet observers found that benchmark developers still barely collaborate, leaving the third-party AI audit ecosystem fragmented.

2026-10-28 ~ 2026-10-28 · 2 related posts

• AI eval leaders from OpenAI to NIST meet as benchmark ecosystem stays siloed — typewriters · 2026-10-28
• Benchmark builders from private sector and nonprofits aren't talking to each other — typewriters · 2026-10-28