Stanford prof warns BioReason benchmark has task definition flaws and prompt leakage

anshulkundaje · x · 2026-10-03

Stanford professor Anshul Kundaje argues the so-called "multimodal biological reasoning" model isn't really that, and its BioReason benchmark has serious task-definition problems plus information leakage through prompts. He advises against using these tasks for benchmarking or building on those task definitions.

Related event: Stanford's Kundaje blasts AI×Bio research rigor and NeurIPS reviewing(14 posts)→

Original post →

More from Research

Research channel →