Nature paper turns pathologists’ slide-viewing behavior into training data for AI agents
yuyinzhou_cs · x · 2026-07-25
A Nature Biomedical Engineering paper introduces Pathology-CoT, a framework that turns expert whole-slide-image viewing behavior into scalable supervision for AI agents.
What it does
- Records how pathologists navigate slides in a standard viewer.
- Converts raw interaction logs into standardized behavioral commands and bounding boxes.
- Builds paired supervision for “where to look” and “why it matters”.
Why it matters
- Whole-slide pathology is an interactive, multi-stage task, but most agentic systems lack the tacit viewing behavior that experts use in practice.
- The authors argue that this missing experience-based supervision is a major bottleneck for AI pathology agents.
Results
- They built Pathology-o3, a two-stage agent that first proposes regions of interest and then performs behavior-guided reasoning.
- On gastrointestinal lymph node metastasis detection, Pathology-o3 outperformed state-of-the-art vision-language models.
- The gains were consistent across multiple VLM backbones and held on an independent external validation cohort.
Takeaway
The work suggests that expert interaction traces can be mined into useful supervision for medical AI agents, not just text labels.
More from Research
- Chinese Room argument resurfaces in the modern LLM understanding debate — Roger_M_Taylor · 2026-07-25
- Jetson-PI: Boosting Onboard VLA Control Frequency to 6Hz, 8.6x Faster — 机器之心 · 2026-07-25
- Surya Ganguli says physics may be a better route to understanding AI than theorem-proof theory — SuryaGanguli · 2026-07-25
- Continued BPE training improves tokenizer extension and pruning across model families — burkov · 2026-07-25
- ARC-AGI-4 should stay private, after Opus 5 scored 3× the next-best model on ARC-AGI-3 — burny_tech · 2026-07-25
- Compiled by Claude: A Comprehensive List of NeurIPS Workshops — DanielKhashabi · 2026-07-25