USC's Zeta Law paper uses Riemann zeta function to predict when data is enough for discovery
PTenigma · x · 2026-11-05
Paul Thompson (USC) published "The Zeta Law of Discoverability in Biomedical Data," tackling the core question of how much data is enough for reliable scientific discovery.
- Argues existing scaling laws and sample complexity theory fail to explain the highly variable gains seen across domains, especially biomedical settings with high-dimensional signals aligned across heterogeneous data
- Proposes a unified cross-modal discoverability framework based on the spectral structure of data, signals, and their alignment: metrics like AUC can be expressed via an effective signal-to-noise parameter
- Addresses when you need better models vs. better input variables, and how much data suffices for clinically useful diagnostic models, invoking the Riemann zeta function
- The surrounding thread discusses modal analysis of non-normal matrices and the author's use of Davis-Kahan, Weyl's inequality, and Vershynin's law in prior data scaling-law work
More from Research
- MiniMMD PhD thesis on arXiv: minimizing MMD from theory to practice — LesterMackey · 2026-11-05
- AAAI Rebuttals Turn Brusque: Bare Data Dumps Replace Courteous Responses This Year — Warm_Ad4302 · 2026-11-05
- Data Analysis Finds Top-Percentile Lawyers' Clients Face 1.6x Higher SEC/DOJ Scrutiny — doodlestein · 2026-11-05
- CUHK and Microsoft's EchoChat hits 8.64 on EchoEval for empathetic speech dialogue — jiqizhixin · 2026-11-05
- AgentVQA From Princeton Offers Offline Agentic Visual Benchmark to Cut Costly Online Evals — Key_Recording9766 · 2026-11-05
- GameVerse releases minute-scale gameplay dataset for long-horizon interactive world modeling — AlayaLab · 2026-11-05