Nature paper turns pathologists’ slide-viewing behavior into training data for AI agents
yuyinzhou_cs · x · 2026-07-25
A Nature Biomedical Engineering paper introduces Pathology-CoT, a framework that turns expert whole-slide-image viewing behavior into scalable supervision for AI agents.
What it does
- Records how pathologists navigate slides in a standard viewer.
- Converts raw interaction logs into standardized behavioral commands and bounding boxes.
- Builds paired supervision for “where to look” and “why it matters”.
Why it matters
- Whole-slide pathology is an interactive, multi-stage task, but most agentic systems lack the tacit viewing behavior that experts use in practice.
- The authors argue that this missing experience-based supervision is a major bottleneck for AI pathology agents.
Results
- They built Pathology-o3, a two-stage agent that first proposes regions of interest and then performs behavior-guided reasoning.
- On gastrointestinal lymph node metastasis detection, Pathology-o3 outperformed state-of-the-art vision-language models.
- The gains were consistent across multiple VLM backbones and held on an independent external validation cohort.
Takeaway
The work suggests that expert interaction traces can be mined into useful supervision for medical AI agents, not just text labels.
More from Research
- LoMa Paper Ships REALLY HardPairs Dataset, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11
- Johns Hopkins Launches Full-Stack Hands-on Robot Learning Class with SO-101 Arm Kits — _krishna_murthy · 2026-09-11
- SyncWorld: In-Context Robot World Model Simulates Unseen Views and Embodiments Zero-Shot — ChongZzZhang · 2026-09-11
- A 3D Pose Dataset for Dogs Released — ducha_aiki · 2026-09-11
- Five tells that still make AI video read as AI, from physics glitches to missing operators — NewPhoneWhotiz · 2026-09-11
- AnyMatch accepted to ECCV 2026 with a NoPresenter design — ducha_aiki · 2026-09-11