ReferTrack tracks language-specified targets with one camera and reaches 89.4% on EVT-Bench
tencent · hf · 2026-07-24
ReferTrack proposes a referring-then-tracking pipeline for embodied visual tracking.
- It tackles EVT with a single forward-facing camera.
- The model first selects the target from indexed bounding boxes, then predicts tracking waypoints.
- To preserve motion cues, it keeps a sliding window of previously selected boxes and injects their geometry through TVBI tokens.
- It also co-trains on a custom Refer-QA dataset to improve target identification.
On EVT-Bench, it reports state-of-the-art single-view success rates of 89.4%, 73.3%, and 74.1% on the single-target, distracted, and ambiguity splits.
The authors also say real-world deployments on legged and humanoid robots show strong sim-to-real transfer. Code is available on GitHub.
More from Embodied
- ROS names Alejandro Hernández Cordero new project lead, eyes 2027 release — ___Mufasaa · 2026-10-27
- ROS Meetup coming to Google's NYC office Oct 29 with speakers from Tangent, Cohesive Robotics, Intrinsic — kscottz · 2026-10-27
- Tesla officially expands robotaxi service area across much of Houston, Texas — Polymarket · 2026-10-27
- Walden Robotics teaches robots to call for help, blending remote assist with autonomy — adnothing · 2026-10-27
- Folding-screen hinges: dozens of ultra-precise parts, one grain of sand can kill the panel — BenBajarin · 2026-10-27
- No π0 weights changed: Motoniq layer lifts real-robot precision fitting from 0/10 to 9/10 — hbouammar · 2026-10-27