Jetson Thor day 1: local VLM + RealSense 3D vision describes scenes every 350ms
chrismatthieu · x · 2026-09-03
The author's day-1 build with NVIDIA Jetson Thor: a fully local robot perception stack combining Intel RealSense RGB+depth with a local 4B Qwen VLM that describes what it sees roughly every 350ms, plus real-time distance estimates in left/center/right directions and center-mass range — all on-device with no cloud.
The takeaway: pixels tell AI what the world looks like, depth tells robots where and how it works. Next step is mounting the whole setup on an actual robot.
Related event: Devs Test NVIDIA Jetson Thor Running VLMs Locally(2 posts)→
More from Embodied
- Opus-assisted open design: a $31k low-field head MRI sketched in hours — DreamFly_13 · 2026-10-18
- DIY robotics build: servo mechanism tested, wide yaw range but limited pitch — _Stocko_ · 2026-10-18
- Brain implants are restoring speech to people with ALS, Science reports — EricMTrautmann · 2026-10-18
- Meta wearables VP runs his AI agent across 3 phones and 23 pairs of glasses — nikola_mr64990 · 2026-10-18
- DeepSeek reportedly invests in embodied AI startups, in talks with robot founders — 量子位 · 2026-10-18
- AMI-EV: spinning prism gives event cameras stable texture, Science Robotics 2024 — RexDouglass · 2026-10-18