Nature paper turns pathologists’ slide-viewing behavior into training data for AI agents
yuyinzhou_cs · x · 2026-07-25
A Nature Biomedical Engineering paper introduces Pathology-CoT, a framework that turns expert whole-slide-image viewing behavior into scalable supervision for AI agents.
What it does
- Records how pathologists navigate slides in a standard viewer.
- Converts raw interaction logs into standardized behavioral commands and bounding boxes.
- Builds paired supervision for “where to look” and “why it matters”.
Why it matters
- Whole-slide pathology is an interactive, multi-stage task, but most agentic systems lack the tacit viewing behavior that experts use in practice.
- The authors argue that this missing experience-based supervision is a major bottleneck for AI pathology agents.
Results
- They built Pathology-o3, a two-stage agent that first proposes regions of interest and then performs behavior-guided reasoning.
- On gastrointestinal lymph node metastasis detection, Pathology-o3 outperformed state-of-the-art vision-language models.
- The gains were consistent across multiple VLM backbones and held on an independent external validation cohort.
Takeaway
The work suggests that expert interaction traces can be mined into useful supervision for medical AI agents, not just text labels.
More from Research
- Speculative Diffusion Paper Maps the Speed-Quality Pareto Frontier via Two Tradeoffs — UCLA · 2026-10-26
- Git Records Fall Short for Auditing AI's Role in Research Repositories, Paper Finds — Koutian Wu · 2026-10-26
- What a 'Fused DeepLIFT' Actually Means: Gradient Overrides Without Hooks — jmschreiber91 · 2026-10-26
- New paper: AI agents negotiate badly under uncertainty and break deals on purpose — menhguin · 2026-10-26
- Cherimoya v0.3.1 Ships Fused DeepLIFT, ~7x Faster Attribution for Genomics Models — jmschreiber91 · 2026-10-26
- Proto-tools, a universal infrastructure layer for generative biology, now open source — jmschreiber91 · 2026-10-26