SAM 3.1 + DINOv3 combo tracks and counts surgical instruments locally in real time
MaziyarPanahi · x · 2026-10-06
MaziyarPanahi shared a real-time surgical instrument tracking pipeline: SAM 3.1 segments the tray once at t=0:14, then DINOv3 compares each region against baseline every 0.2s. A similarity below 0.80 for 5+ seconds marks an instrument off-tray, while a passing hand dips the score for at most 3.4s before recovery. The demo caught one instrument returned at 0:37 and an osteotome removed at 0:29.8 that never came back — all running locally.
Related event: DINOv3 + SAM Enable Local Real-Time Surgical Instrument Counting(3 posts)→
More from coding & agent
- Tested: running Claude Code through grokbot is a fast track to account bans — aigclink · 2026-10-06
- Crimsonland port adds verifiable leaderboard via deterministic server-side replay of inputs — banteg · 2026-10-06
- Spark creator Josh Rosen: AI systems should steal far more from data engineering — colinmcnamara · 2026-10-06
- AI coding agents build computer vision apps on real-world Jetson Orin NX hardware — chrismatthieu · 2026-10-06
- 18,000+ runs: new study shows how agent configuration shapes performance on 4 scientific tasks — zeynepakata · 2026-10-06
- AI agents killed my flow state — here's the task-mixing method that got it back — haltakov · 2026-10-06