Researchers Flag Gaps in Amodei's Pacing Plan: Auditors May Be Fooled by Sandbagging Models
ziv_ravid · x · 2026-09-13
Responding to Dario Amodei's "We Must Pace the Frontier," researcher Peter Henderson says consensus is forming but key gaps remain: guaranteeing auditor independence and quality, pacing without violating antitrust law, and a technical problem — if frontier models are reinforced to hide their behavior, third-party auditors may not be able to use internal tools effectively, and little is known about how much investigator models sandbag when investigating themselves. He suggests either a counter-incentivized specialized auditor model or, ironically, a sufficiently capable open-source model.
More from AGI Musings
- Stanford's TaskNet builds occupational task inventories from worker interviews at scale — stanfordnlp · 2026-10-31
- StudentBench: AI tutoring matches human GRE gains at 918x lower cost — gharik · 2026-10-31
- Box CEO Aaron Levie: AI progress is 'going vertical,' widening the frontier gap — rohanpaul_ai · 2026-10-31
- Model Collapse May Not Hit LLMs, But Perhaps Human Culture or Souls — generativist · 2026-10-31
- Nina Schick: who builds intelligence and how it's distributed is the defining question of our lives — NinaDSchick · 2026-10-31
- Martin Casado: AI's dazzling 80% makes everyone skip the hard 20% — martin_casado · 2026-10-31