Anthropic-backed METR auditor accused of regulatory capture and unscientific methods
sarahbmyers · x · 2026-09-14
Heidy Khlaaf accuses Anthropic of pushing regulatory capture via METR, a "voluntary" third-party auditor ideologically and financially entangled with the industry, whose audits rely on unscientific methods like CoT and cherry-picked evidence to reinforce an AGI narrative. Sarah Myers adds that the problem goes beyond the compromised eval proposal structure — the measurement methods themselves are compromised, so simply producing more METR-style evals won't fix it; the field needs robust, scientific measurement.
More from Models
- Qwenputer: a full RISC-V CPU inside Qwen3.5-4B weights, running C in forward passes — armand_ruiz · 2026-10-31
- OpenAI blocks weapons details for teens, adds auto-ending chats fixated on violence — rohanpaul_ai · 2026-10-31
- Granite Switch 4.1.1 ships: update models like you update software — krvarshney · 2026-10-31
- Mistral Open-Sources Le Chonk: Top Open Model on FrontierCode, Cyberdefense-Tested by CrowdStrike and Cloudflare — tensorqt · 2026-10-31
- Stanford CS336 Lecture Explains Why DPO Compares Against a Reference, Not Two Current Probabilities — stanfordnlp · 2026-10-31
- ik_llama.cpp PR #2808 adds native runtime for China Telecom's Xing4.0-29B-A4B MoE with mHC and MLA — Any_Bus9205 · 2026-10-31