Stanford's Kundaje slams BioReason's variant effect evals as 'extremely flawed'
anshulkundaje · x · 2026-10-23
Responding to Loubna Ben Allal's claim that Carbon-X's strongest results are in mutation effect prediction, Stanford professor Anshul Kundaje says these are not serious evals: the BioReason evals are 'extremely flawed' and the other comparisons are 'totally pointless in most cases.' He argues the field should benchmark against established resources like AlphaMissense, PromoterAI, AlphaGenome, SpliceAI/2 and TraitGym.
More from Research
- Michael Levin's new slide: mind encloses matter, not the other way around — cephaloform · 2026-10-23
- OpenTac from JHU and MIT auto-designs 3D tactile skins for robot hands — anand_bhattad · 2026-10-23
- Stanford's Anshul Kundaje calls BioReason's variant effect prediction evals seriously flawed — anshulkundaje · 2026-10-23
- Science cover: 3-agent AI nearly doubles physician diagnostic accuracy at lower cost — EricTopol · 2026-10-23
- 3-agent AI nearly doubles diagnostic accuracy vs physicians at lower cost in 600+ NEJM/ER cases — EricTopol · 2026-10-23
- DeepMind paper: model bidding auction hits 99.2% of optimal routing without knowing which model is best — rohanpaul_ai · 2026-10-23