Open Source WebXR Project Turns Phones and VR Headsets into Robot Arm Teleoperation Devices
tom_doerr · x · 2026-08-08
SpesRobotics has open-sourced a project on GitHub called teleop, capable of transforming smartphones or VR headsets into teleoperation devices for robotic arms.
- Core Technology: Leverages the WebXR API and phone sensors to detect the device's orientation and position in 3D space. The server receives this data and sends it to the robot arm controller.
- Setup: Install and launch the server on a computer, open the provided URL on the phone, tap Start, and hold the Move button to control the arm.
- Compatibility: Requires WebXR API support. iPhone users need to use XR Browser or WebXR Viewer (Safari does not support WebXR).
- Tested Setups: Successfully validated for teleoperating a physical Lite6 robot and a simulated UR5e robot in Webots.
More from coding & agent
- Dev Test: DeepSeek Shockingly Good at Mobile Background Location Tracking — haydendevs · 2026-08-08
- Video Rendering with Codex Overloads Mac, Dev Shifts to Cloud — nickbaumann_ · 2026-08-08
- GitHub Copilot CLI Update: Enterprise Sandbox Policies, tgrep for Large Monorepos — copilot-cli-release-app[bot] · 2026-08-08
- Workflow Share: Generate UI Screenshots First, Then Let Agents Code — tristanbob · 2026-08-08
- HeyGen Employee Shares AI Video Production Workflow — DesireeCachette · 2026-08-08
- When will Devin go mobile? T3 Code demonstrates remote PC control on weak WiFi — NERDDISCO · 2026-08-08