Preprint: data leakage yields AUC near 0.8 from pure noise in proteomics
bttyeo · x · 2026-09-11
A new preprint quantifies a common flaw in proteomics biomarker studies—data leakage: with NO true signal, some leaked runs still reached AUCs near 0.8.
The team (JakeVogel, Caitlin Finney, Artur Shvetcov et al.) notes leakage is widespread; even simple mistakes produce AUCs >0.7 from pure noise while worsening generalization. They built tools to help researchers detect and avoid leakage and are pushing for trustworthy reporting standards.
Related event: Preprint Quantifies Data Leakage: Near-0.8 AUC With No Signal(2 posts)→
More from Research
- Should researchers drop their marginal papers? A call for an RCT — RishiBommasani · 2026-09-11
- Science Advances paper introduces Media Bias Detector to measure publisher bias at scale — duncanjwatts · 2026-09-11
- OpenAI reportedly aims its new internal model at Riemann and P vs NP — zephyr_z9 · 2026-09-11
- Google brings 41 accepted papers to ECCV 2026, from video spatial understanding to TIPSv2 — ymatias · 2026-09-11
- OpenAI's internal model claims a Navier-Stokes millennium prize proof, says analyst — QuintinPope5 · 2026-09-11
- Open-sourced MCP server predicts Dutch court outcomes after stripping 92% target leakage — rechtssysteem · 2026-09-11