Stanford Professor Flags Serious Flaws in BioReason Variant Effect Evaluation
Stanford professor Anshul Kundaje criticized the BioReason benchmark's variant effect prediction as methodologically unsound and questioned the SmolLM team's accounting of train-test leakage in discussions with Hugging Face's Loubna Ben Allal.
2026-10-23 ~ 2026-10-23 · 2 related posts
- Stanford's Anshul Kundaje calls BioReason's variant effect prediction evals seriously flawed — anshulkundaje · 2026-10-23
- Stanford's Anshul Kundaje presses SmolLM lead on train-test leakage accounting in benchmarks — anshulkundaje · 2026-10-23