Stanford's Zitnik: Biomedical Discovery Lacks Hard Verifiers, Blocking AI Scientist Loops
marinkazitnik · x · 2026-09-01
Marinka Zitnik (Stanford) discusses why verification is the key bottleneck for closing the loop in AI-driven biomedical discovery: unlike math and program search, where proof checkers or test suites can evaluate candidates exactly and cheaply in real time, biomedicine has no such verifiers.
Her three points:
- Training must account for sparse, delayed, noisy feedback, learning across loops that run weeks or months, with credit assignment both within a single reasoning trajectory and across repeated cycles.
- Verification needs both soft verifiers (simulations, surrogate/world models, retrieval, learned judges) to guide at scale, and hard verifiers that interrogate the biological system directly — stronger but graded, noisy, context-dependent, costly and delayed.
- Evaluation must test whether the AI scientist closes the loop: not just generating good hypotheses, but selecting informative experiments, revising hypotheses, and changing course when results contradict its explanation.
Related event: Closing the Loop: Verification Bottlenecks AI Scientists in Biomedicine(3 posts)→
More from AGI Musings
- 1996 Sugarscape Model: Early Origins of Agent Tech — generativist · 2026-09-01
- New paper: a structured ladder for scaling large reasoning models beyond human supervision — Zhiqin Yang · 2026-09-01
- Trust: The Biggest Barrier and Driver for Personal Agent Adoption — petergyang · 2026-09-01
- The Next AI Revolution Won't Be One Assistant. It Will Be An Entire Team of AI Agents — CurieuxExplorer · 2026-09-01
- Agentic commerce is the future, replacing websites — thisiskp_ · 2026-09-01
- Is AI Leading Us Toward Singularity? The Shift in Control and Power — CurieuxExplorer · 2026-09-01