METR graded its own independence, failing exactly one criterion: conflict-of-interest disclosure
kevinnbass · x · 2026-09-15
kevinnbass flags that AI safety evaluation org METR assessed its own independence against its own standardized criteria, scoring well on most metrics — but suspiciously failing only on stating a conflict-of-interest disclosure policy, buried mid-report across 300+ pages. suchenzang notes METR was at least honest about implying it, and that AI now makes such findings easy to surface.
More from Safety
- Expert panels map 21 clinical AI risks; adversarial tests show autonomous care still unsafe — AleksandraFaust · 2026-10-31
- AI security's dark age: agents can probe every endpoint and attack surface — graceisford · 2026-10-31
- AI dinner takeaways: orgs shipping 5x faster, yet GDP isn't growing 30% a year — graceisford · 2026-10-31
- Android hit by 'SMS of death' bug tracked as CVE-2026-58882 — l4rz · 2026-10-31
- Debating ExploitBench: would 96.8% from a flash model break the nonlinear-intelligence thesis? — teortaxesTex · 2026-10-31
- Jhaddix: AI-Powered Bug Bounty Hunters Are the Cutting Edge — Don't Kill Your Program Now — rez0__ · 2026-10-31