Stanford's Training Witnesses: certify ML training runs without trusting the trainer
pratyusha_PS · x · 2026-10-02
Researchers from Stanford and NYU (Houjun Liu, Pratyusha Sharma) introduce Training Witnesses (arXiv:2609.33915), a method to certify neural network training, data usage, and evaluation.
Key points:
- With the explosion of papers, verification burden falls on readers who must reproduce expensive runs; the authors move the burden of proof to the trainer
- Core insight: fast behavioral fingerprints plus occasional replay challenges are sufficient to audit training
- Minimal overhead for trainers, cheap for verifiers, rejects bad runs with amplifiable probability, and supports exact queries of data inclusion/exclusion
- Tested on LM training runs from 100M to 2B scale across DDP and FSDP
- Comes with a self-regulating leaderboard of "auto-certified" runs for shared baselines and reproducibility
Related event: Stanford and NYU Unveil 'Training Witnesses' for Verifiable AI Training(3 posts)→
More from Research
- Interview: Medical AI is only as good as human consensus labels — CurieuxExplorer · 2026-11-22
- Science cover paper runs contextuality tasks on up to 105 qubits of Google's Willow chip — dhruv2038 · 2026-11-22
- Why a P=NP proof would collapse most of modern cryptography — doctorBobG · 2026-11-22
- 10 months after a Reddit question on AI solving Millennium Prize Problems, claims abound — haider1 · 2026-11-22
- Fable 5.2 rewrites model weights so an E2E driving bot learns left-side driving — 4310sy · 2026-11-22
- IceCube citizen science challenge draws 4,000+ classifications to help train AI — CatAstro_Piyush · 2026-11-22