Nature paper turns pathologists’ slide-viewing behavior into training data for AI agents
yuyinzhou_cs · x · 2026-07-25
A Nature Biomedical Engineering paper introduces Pathology-CoT, a framework that turns expert whole-slide-image viewing behavior into scalable supervision for AI agents.
What it does
- Records how pathologists navigate slides in a standard viewer.
- Converts raw interaction logs into standardized behavioral commands and bounding boxes.
- Builds paired supervision for “where to look” and “why it matters”.
Why it matters
- Whole-slide pathology is an interactive, multi-stage task, but most agentic systems lack the tacit viewing behavior that experts use in practice.
- The authors argue that this missing experience-based supervision is a major bottleneck for AI pathology agents.
Results
- They built Pathology-o3, a two-stage agent that first proposes regions of interest and then performs behavior-guided reasoning.
- On gastrointestinal lymph node metastasis detection, Pathology-o3 outperformed state-of-the-art vision-language models.
- The gains were consistent across multiple VLM backbones and held on an independent external validation cohort.
Takeaway
The work suggests that expert interaction traces can be mined into useful supervision for medical AI agents, not just text labels.
More from Research
- Stanford Data-Centric AI Workshop reopens site, extends poster deadline — jure · 2026-10-26
- Hugging Face wraps 6-month Training Agents series with open recordings and code — SergioPaniego · 2026-10-26
- 'Vibe verification': ~60% of AI-written formal specs prove the wrong property — basedjensen · 2026-10-26
- Ito: a browser that detects browsing intent and auto-organizes tabs into Flows — andrewkuznet · 2026-10-26
- Cornell study says brains process language as linear sequences, challenging Chomsky's hierarchy — anirbanbandyo · 2026-10-26
- Hi3D V1.0 open-sourced with 2M training assets and 90% slicing success rate — kimmonismus · 2026-10-26