NVIDIA shows AI agents teaching a robot to walk an obstacle course in sim

tomaszbednarz · x · 2026-11-04

NVIDIA's technical blog details an end-to-end workflow where AI agents (Hermes, Nemotron 3.5 Bolt, Astra) turn a prompt into a project plan, build 3D assets in FreeCAD/Blender, assemble the scene in Isaac Sim with Newton physics, then train a perception-and-locomotion policy in Isaac Lab across 4,096 parallel environments on an RTX PRO 6000 Blackwell GPU. The policy is validated locally on RTX Spark before sim-to-real transfer with better actuator models and domain randomization. All assets and a Hugging Face sim-to-real tutorial are publicly available.

Original post →

More from coding & agent

coding & agent channel →