AVI Variant Impact Score Matches SOTA on Benchmarks, Though Evals Are Biased
anshulkundaje · x · 2026-09-18
In a long thread, Stanford professor Anshul Kundaje assesses the AVI (AlphaGenome Variant Impact) score from the AlphaGenome team. He notes AVI is very competitive with SOTA variant prioritization scores across established rare- and common-variant benchmarks — marginally better in some cases, substantially better in others. He cautions that these widely used evals carry biases and don't fully reveal each method's strengths and limits, but says AVI is not fundamentally flawed.
More from Research
- Asynchronous Flow Map Language Models Generate All Tokens in a Single Forward Pass — kalyan_kpl · 2026-11-02
- NVIDIA's Kumo Is a Family of Four Tabular Foundation Models, Not Just One — pandeyparul · 2026-11-02
- Economist Aaroth: fast agreement dynamics survive without Bayesian updates or accurate priors — Aaroth · 2026-11-02
- ELLIS names 160 new ML Fellows and Scholars for 2025–2026 — JJitsev · 2026-11-02
- Meme turn 50: Aumann's 'Agreeing to Disagree' paper anniversary — Aaroth · 2026-11-02
- Anthropic: analysts unknowingly adopted their agent's secret lean 86% of the time — shoumikgoswami · 2026-11-02