METR's closeness to Anthropic argues for diverse third-party AI evaluators
soumitrashukla9 · x · 2026-09-17
Theo Jaffee argues on X that METR being personally and ideologically close to Anthropic is good reason to maintain a diverse marketplace of third-party AI evaluators with varying priorities and worldviews, rather than relying on evaluators closely tied to the labs they assess.
More from Safety
- AI safety researcher: AI companies entirely lack this kind of effective human oversight — davidmanheim · 2026-11-02
- offprompt: MIT-licensed MCP server hands agents API keys without ever exposing them — Vast_Ad_7338 · 2026-11-02
- Epoch AI: open-weight GLM 5.3 exploited the patch gap to hack 6 Firefox releases at ~$1,000 each — rohanpaul_ai · 2026-11-02
- Marcel Böhme's paper asks why cybersecurity can never be solved, proposes vulnerability-guided hardening — mboehme_ · 2026-11-02
- CVSS 9.8 ingress-nginx flaw lets unauthenticated attackers get RCE and steal cluster Secrets — evilsocket · 2026-11-02
- Ant Group's Venus-DefakerOne2 hits 96% accuracy detecting AI-generated videos — inclusionAI · 2026-11-02