Peking University and NVIDIA use a coding agent to replace teleoperation for robot data
DAGroup-PKU · hf · 2026-11-05
Peking University and NVIDIA present PyRUA-DataFarm: an LLM coding agent that takes over teleoperators' job in collecting robot demonstrations.
- Process: given a data request and one calibration episode of the real robot in a target scene, the agent rebuilds the task in simulation — writing the scene, an expert controller, and a success judge; a video model conditioned on real images renders each rollout as photographic video with all camera views generated consistently.
- Output: synchronized, labeled "real-ready" training data at lower cost than human teleoperation.
More from coding & agent
- Stop building half-baked multi-agent systems: design agents that run real engineering workflows — Pavan_Belagatti · 2026-11-05
- Celesto launches hosted cloud-sandbox MCP: run agent tasks with one prompt — aniketmaurya · 2026-11-05
- shadcn predicts T3 Code will drop the Code and be just T3 by 2027 — shadcn · 2026-11-05
- Neal Khosla: agents will cause "friction collapse" and break today's social norms — rbhar90 · 2026-11-05
- Cherry Pi harness in Lua and Go: script terminal panes, run tests, drive Rex from one script — sull · 2026-11-05
- InfraStack launches free threat-intel skill so Claude Code and Cursor can catch CVEs while coding — Scobleizer · 2026-11-05