BioSimBench: frontier LLMs ace biology benchmarks but fail at predicting real cell experiments

alex_verem · x · 2026-11-05

CellType's BioSimBench tests frontier models against real cellular responses to drugs, gene knockdowns, and immune signals. Even the strongest models get only part of the response right — benchmark scores don't translate to predicting reality.

Related event: CellType Releases BioSimBench: 27B RL Model Beats 12 Frontier Models at Simulating Cell Responses(7 posts)→

Original post →

More from Models

Models channel →