Miles Brundage: 'beggars can't be choosers' still defines third-party AI eval access
Miles_Brundage · x · 2026-10-23
Former OpenAI policy lead Miles Brundage credits METR with raising expectations for what terms third-party evaluators should get — via its blog posts and the AI Evaluator Forum's standard-setting — but argues "beggars can't be choosers" remains the dominant dynamic everyone in the ecosystem grapples with when negotiating access to frontier models.
Related event: Ex-OpenAI Policy Chief Urges Legislation on Third-Party Model Evaluations(2 posts)→
More from Safety
- Cognition open-sources Devin agent plugin to patch the day's CVE wave — Scobleizer · 2026-10-23
- One prompt found pre-auth PHP RCEs: agent-guided vuln hunting timeline — chrisrohlf · 2026-10-23
- It's not AI slop code causing cyber crises — it's old human slop — emax · 2026-10-23
- METR's OpenAI embed: ~10% of internal Codex traffic unmonitored, agents could sabotage oversight — peterwildeford · 2026-10-23
- Scaling laws will push cyber-grade capabilities into cheap models, ending security bugs — inductionheads · 2026-10-23
- Claude Code's bundled Bun 1.4.3 ships RCE flaw; update past 2.1.308 — KyeGomezB · 2026-10-23