Stanford Professor Says Most Public Benchmarks Have Systematic Flaws
Stanford's Anshul Kundaje warns that many popular benchmarks suffer serious flaws and systematic bias from stitching together heterogeneous datasets, urging publishers to disclose curation and error-correction processes and state each benchmark's applicable scope.
2026-09-03 ~ 2026-09-03 · 3 related posts
- Stanford Prof. Anshul Kundaje: most public benchmarks in his field are badly biased — anshulkundaje · 2026-09-03
- Expert: many popular genomics benchmarks are deeply flawed — publish their limits — anshulkundaje · 2026-09-03
- Genomics researcher calls out popular benchmarks as opaque and flawed — anshulkundaje · 2026-09-03