SAM + DINOv3 turns a surgical tray into a local visual search engine

MaziyarPanahi · x · 2026-10-03

The author combined SAM 3.1 + DINOv3, fully local, to turn a single frame of a surgical instrument tray into a visual search engine: SAM isolates each instrument into masks, DINOv3 compares the content inside each mask by visual similarity. Using one instrument as the query, all others are ranked by similarity — no need to even know the instrument names. Next step: keeping the selection tracked as instruments move in video.

Related event: Dev Combines DINOv3 and SAM 3.1 into Fully Local Visual Search Engine(2 posts)→

Original post →

More from coding & agent

coding & agent channel →