Agent autonomously installs PyTorch and Depth Anything, then drives a robot to a ball via API only
armand_ruiz · x · 2026-09-19
A developer exposed just an API and asked @muse to drive their robot to a ball. Muse noticed the camera feed was 2D, installed PyTorch and Depth Anything from GitHub inside its own VM, and then drove the robot — choosing its own tools along the way.
The key enabler is the VM design: per-user and persistent, letting the agent install dependencies freely. By contrast, Astra gets a shared sandbox and cannot do this without prior setup.
Related event: Muse Agent Installs PyTorch Itself to Drive a Real Robot(2 posts)→
More from coding & agent
- Muse Opens Connector Platform: Developers Plug In APIs to Reach Agent Users — jffwng · 2026-09-19
- Jasper's open RL guide: shaping rewards to train a search agent end-to-end — simonguozirui · 2026-09-19
- Make Your Evals Better: More Edge Cases and Real User Inputs, Not Synthetic Slop — cephaloform · 2026-09-19
- Agent runs full SEO audit of Opendoor in 4.5 minutes, surfacing 500+ link opportunities — morganb · 2026-09-19
- AWS's Marc Brooker on the future of code review: LLMs plus automated reasoning — alexisgallagher · 2026-09-19
- Thorsten Ball demos agent picking its next command from shell history — IanArawjo · 2026-09-19