NVIDIA & Berkeley open source tactile robotics method T-Rex

DrJimFan · x · 2026-08-22

NVIDIA and UC Berkeley open-sourced T-Rex, a tactile learning methodology for robotics addressing the lack of touch sensing. Key contributions include: (1) Architecture: A mixture-of-transformer running async clocks—a slow visuomotor expert plans motion while a fast tactile expert refines it at 4 touch ticks per vision tick. (2) Dataset: The largest tactile dataset released (50 hours, 5.5k episodes) collected on SOTA 22-DOF hardware. (3) Training: Extends EgoScale, using egocentric video for pretraining and tactile robot play for mid-training, bridging the gap to contact-rich manipulation. Tactile sensing is emphasized as critical for the "last mile" of manipulation.

Related event: NVIDIA and UC Berkeley Open-Source T-Rex Tactile Robot Learning(2 posts)→

Original post →

More from Embodied

Embodied channel →