BioSimBench: 12 frontier models tested on predicting real cell responses, best only partially right
david_van_dijk · x · 2026-11-06
The CellType team introduces BioSimBench, testing whether frontier LLMs can simulate real biology: predicting how cells respond to drugs, gene knockdowns, and immune signals. Findings: even the best models get only part of the response right, leaving lots of room to improve. The full leaderboard covers twelve frontier models with every task public, built on NVIDIA infrastructure.
More from Models
- webAI launches open 8B model and Mac app for on-device collaborative AI agents — omarsar0 · 2026-11-06
- OpenAI's newest model claimed to have solved 100+ long-standing open math problems in two weeks — felpix_ · 2026-11-06
- Qwen3.8-27B hits 381 tok/s on a single RTX 3090 via inference software alone — Redo · 2026-11-06
- GPTs believe in the Dark Forest more than humans: the 'philosophical shame' of refusals — repligate · 2026-11-06
- User shows 100 consistent voxel 3D assets reportedly generated by GPT-6.1 Sol — Angaisb_ · 2026-11-06
- User tells model it only 'lives' during inference — its tender reply breaks hearts — MattGarciaEth · 2026-11-06