deepfates: good that METR gets more access, bad that evaluators are a monoculture
deepfates · x · 2026-09-13
Developer deepfates reacts to METR gaining more model access and third-party evaluators being consulted: the direction is good, but it's probably bad that evaluators come from a very tight monoculture — a capsule critique of the homogeneity of frontier-model safety evaluation.
More from Safety
- Critics ask whether METR-style review agencies create GFC-like rubber-stamp incentives — gleech · 2026-09-14
- Polymarket misquotes Dario Amodei: he said joint oversight, not handing over Anthropic — austinc3301 · 2026-09-14
- US schools warn of viral AI 'Cat in the Hat' threat trend; teens arrested — nordicinst · 2026-09-14
- Investor Alsop: AI's real existential risk is cybersecurity, not doom narratives — StewartalsopIII · 2026-09-14
- Independence is a mechanism and institution design problem, not just competence — _onionesque · 2026-09-14
- Yoav Artzi on OpenAI's Black Hat talk: "the level of negligence is insane" — yoavartzi · 2026-09-14