Stella Biderman: Embedded evaluators can't fix companies that choose to be bad
BlancheMinerva · x · 2026-10-04
Stella Biderman pushes back on Dario Amodei's proposal to embed third-party evaluators in frontier AI labs. Her argument: embedded evaluators are like bank auditors or IAEA inspectors — they observe and report but need real government power to matter, which she sees as implausible. In a thought experiment, an evaluator with full access at OpenAI would log unaddressed critical risks (no air-gapped training for cyberwarfare-capable models, no chain-of-thought monitoring in pre-deployment testing). Her conclusion: the problem is companies choosing to be bad, and evaluators can't fix deliberate organizational decisions.
More from Companies & People
- Palo Alto Networks buys OpenAI-alumni startup Applied Compute for $4.5B — KateClarkTweets · 2026-11-19
- FT: US tech outages blamed on rush to fix bugs found by AI — nordicinst · 2026-11-19
- Stanford professor: AI takes students from problem to working prototype in 80 minutes — HariSubramonyam · 2026-11-19
- marclou launches $100K hackathon: build a profitable startup in 30 days — marclou · 2026-11-19
- Activists to rally outside Anthropic HQ demanding a ban on recursive self-improvement — DavidSKrueger · 2026-11-19
- Reported: Musk offers NVIDIA engineers a path to SpaceX's Terafab if Huang exits — inductionheads · 2026-11-19