Virtual Cell Benchmarks May Be Flawed
BoWang87 · x · 2026-07-08
A paper targeting ICML 2026 points out that standard perturbation benchmarks for virtual cell tasks might have severe issues.
The authors found that simple mean predictors outperform many models on these benchmarks. They argue the issue isn't poor model performance, but rather the evaluation method treating numerous irrelevant genes equally to a few signal genes, leading to distorted scores.
More from Research
- Causal-only attention for non-generative tasks is wasteful, argues HF engineer — antoine_chaffin · 2026-09-11
- Catholic University of Chile researcher: scaling AI feedback is key to sustainable medical education — julianvarascom · 2026-09-11
- Nature paper images cellular activity across all organs, revealing body-wide circuits — arjunrajlab · 2026-09-11
- SignNet 1M Dataset Released for Sign Language Research — ducha_aiki · 2026-09-11
- ECCV26 Oral: Flow Matching Enables Single-Stage Multi-View Point Cloud Registration — ducha_aiki · 2026-09-11
- InFlux++ Method Released — ducha_aiki · 2026-09-11