SAM 3.1 + DINOv3 tracks surgical tools and tells apart near-identical twins on one A100

MaziyarPanahi · x · 2026-10-10

Maziyar Panahi demos the SAM 3.1 + DINOv3 combo from Meta: it keeps tracking surgical tools as a forearm sweeps over them, and can distinguish a tool that left the frame for 15 seconds when its near-identical twin returns — correctly identifying which one came back.

The whole demo runs on a single NVIDIA A100 via Hugging Face Jobs, showing the practical potential of this open vision-model pairing for fine-grained instance tracking under occlusion.

Related event: SAM 3.1 + DINOv3 Combo Delivers Impressive Surgical Tool Tracking(2 posts)→

Original post →

More from Multimodal

Multimodal channel →