Hooking a model up to a robot arm: two USB cameras, an SO-101, ~2 decisions per second
ai · x · 2026-09-29
Developer DaniiarAbdiev gave Jev (typesafe.ai's model) a robot arm: two USB cameras for vision, an SO-101 arm for actuation, with Jev choosing the next move at roughly 2 decisions per second. After one slip and some debugging, the arm went back for the ball and successfully dropped it into a bowl — a demo of real-time robot control on consumer-grade hardware plus a foundation model.
More from Embodied
- Leak: OpenAI has an unreleased AI camera device, early hands-on emerges — ChrisUniverse · 2026-09-29
- Mark Cuban predicts humanoid robots will fail in 5–10 years, homes will adapt to task-specific robots — Polymarket · 2026-09-29
- Humanoid robot reportedly in low-volume production: 5 units planned for 2026 — teortaxesTex · 2026-09-29
- Scoble: lab AI glasses get fold-out camera covers that light up when shooting — Scobleizer · 2026-09-29
- AIST AI Center in Tokyo recruits RAs and postdocs in multi-robot coordination, up to ¥2,100/hour — HirokatuKataoka · 2026-09-29
- ZJU Releases EMem-Bench: 2,554 Episodes to Test Embodied Agent Memory — OmniAI-ZJU · 2026-09-29