e/acc figure claims AI eval firms are ideologically captured ex-lab insiders
TinfoilTricorn · x · 2026-09-13
Sentdex asked whether a single non-EA AI evaluation company actually used by frontier labs exists. beffjezos (e/acc) replied that the "doomer-industrial complex" is ideologically captured: evaluators are mostly former lab employees from one subculture, and branding them "neutral third parties" dodges the issue—they'd hold immense soft power over every AI org overnight once regulatory hooks exist. The exchange spotlights the independence problem at the heart of third-party AI safety evaluation.
Related event: Sentdex Sparks Debate Over EA Ties in AI Eval Industry(6 posts)→
More from AGI Musings
- Skimming Anthropic's S-1: Winner-Take-All Not of a Category, but the Whole Software Ecosystem — mobileraj · 2026-10-31
- CS312 course post explains sharpness and the edge of stability in LLM pretraining — tatsu_hashimoto · 2026-10-31
- NBER paper: training your AI replacement can actually raise workers' pay — joshgans · 2026-10-31
- Trata's Hedge-Bench: no model tops 50% on real-world financial forecasting — ycombinator · 2026-10-31
- Anthropic's internal Claude model claims 2^o(n) 3-SAT algorithm, purportedly refuting the ETH — ctjlewis · 2026-10-31
- Foundry investor: durable companies are built on data loops, not copyable features — alvelda · 2026-10-31