Anthropic Bets $1B on Accenture for Embedded Evaluators as Zvi Flags the Catch
Don't Worry About the Vase (Zvi) · rss · 2026-09-28
Zvi Mowshowitz's deep dive examines the problem with 'embedded evaluators': Dario Amodei's essay 'We Must Pace the Frontier' committed Anthropic to hosting outside evaluators with employee-level access, and OpenAI followed suit with its own pledge plus a call for international coordination — but who hires and pays them?
Key points
- A letter from Geoffrey Hinton, Stuart Russell, and Arvind Narayanan sets minimum standards: meaningful independence, payment decoupled from findings, diverse viewpoints, transparency, protection from retaliation, and employee-level access.
- Gabriel Weil argued developers shouldn't hire their own referees; his mandatory liability insurance proposal helps only marginally.
- Anthropic partnered with Accenture: led by Faculty, covering evaluation, red-teaming, and alignment assessments; each side expects to invest at least $1 billion over five years, with Anthropic funding Accenture directly and talks underway with METR and other nonprofits.
- Zvi argues Accenture (boring, independent) and METR (deep expertise) sit on a Pareto frontier best used together, though Anthropic's funding introduces a conflict of interest. He also teases a wave of undisclosed AI hacking incidents at OpenAI and a new one that forced another pause of its most advanced model.
More from Companies & People
- Ben Thompson: The Demise of Jensen Huang Marks the End of Nvidia's Prospects and the AI Bubble — morqon · 2026-11-16
- Engineer's Interview Prep Method: Use Claude to Find Which Answers Undersell Your AI Work — brandon_galang · 2026-11-16
- CNN meme: Jensen Huang's 'imperial control' reportedly extends to the Nvidia cafeteria brisket — kevinnbass · 2026-11-16
- Stratechery's Fictional Obituary: Imagining Jensen Huang's 2026 Exit From Nvidia — Gregory_C_Allen · 2026-11-16
- AI daily: DeepSeek rate-limits chats, Qwen haggling spurs shop warnings, Doubao workspace launch — 快鲤鱼 · 2026-11-16
- Apple's 4.3 Spam crackdown hits indie devs en masse, even Azam rejected — tinyfool · 2026-11-16