WUJI open-sources MINT: 3D hand trajectory and camera pose reconstruction from egocentric video
chris_j_paxton · x · 2026-09-12
Robotics company WUJI has open-sourced MINT, a system that reconstructs 3D camera trajectories and bimanual hand motion in a shared world coordinate system from first-person RGB video, with retargeting to the WUJI Hand. The release includes model weights, training/inference code, visualization and evaluation tools, EgoPipeline reference code, and structured annotations for 560,649 episodes spanning 1,021 hours of egocentric video — valuable for teaching robots manipulation skills from human videos.
More from Embodied
- cixliv: robot fighting may be the first realized market where bots beat average humans — cixliv · 2026-10-28
- Can the Hiwonder MentorPi T1 run fully offline as a robot pet? Pi 5 questioned — oulu2006 · 2026-10-28
- Testing Mint Modeler to Build the Menlo Research Robot — freelerobot · 2026-10-28
- Khosla-backed startup builds a 'mind-reading' cap with 100,000 tiny chips to write AI prompts — Distinct-Question-16 · 2026-10-28
- Racer turns Ray-Ban Meta glasses into an AI track coach with Opus 5.5, gains 5.3 seconds per lap — Vjeux · 2026-10-28
- Fine-tuning VLAs on TAMP data hits distribution mismatch; DATAFARM gets JAX port — tomssilver · 2026-10-28