NVIDIA Shows Six Projects Building Omniverse Simulations With Frontier AI Agents Like Astra
NVIDIA Blog · rss · 2026-10-09
NVIDIA's blog showcases how developers direct frontier AI agents (branded GPT-6 Astra) with natural language to assemble Omniverse-powered simulation apps, across six projects:
- Humanoid warehouse simulator: Frank DeLise had Astra wire together physics (ovphysx), scene (ovstage), rendering (ovrtx) and UI (ovui) libraries to turn a SimReady warehouse and humanoid robot into an interactive first-/third-person simulator.
- Autonomous-driving testing: Doyub Kim built "Zero to Alpamayo," a reusable environment based on San Francisco's Market Street, staged through asset creation, traffic, RTX sensor simulation and Alpamayo driving; a Cosmos3-Nano experiment varied weather and lighting to compare driving responses.
- Digital twins: Ashley Reid guided Astra and Claude Fable 5 agents to compare ovrtx camera/LiDAR outputs against recorded data, creating two twins from scratch and improving two existing ones in about three days, with camera and LiDAR metrics as acceptance criteria.
- Robo Olympics: Tae Kim used sports videos to have Astra build controllers for simulated Unitree G1 humanoids, validated with Newton Physics Engine and Warp — the robot cleared a hurdle in 64 of 100 trials.
- Robotic disassembly: Jens Jebens combined PTC Onshape CAD with Isaac Sim; Astra designed a wrench that could reach suspension bolts and a component was removed in simulation.
- ISS in the browser: Nic Johns assembled NASA assets into an OpenUSD International Space Station app with telemetry via a single prompt.
The piece frames a new "human directs, agent executes, metrics validate" paradigm for simulation development.
More from coding & agent
- Autorubric ships 25-recipe cookbook for rubric design, judge calibration and cost control — deliprao · 2026-10-09
- Logo.dev Launches MCP Server So AI Agents Can Fetch Brand Assets Anywhere — alexbaldwin · 2026-10-09
- Designer's Portfolio AI Agent Blocks Abuse on Day One for Just $2.83 in Credits — tomjohndesign · 2026-10-09
- OpenRouter co-founder: agent loops are the new table stakes, not differentiation — markjeffrey · 2026-10-09
- Dev's blunt advice: don't announce online that you vibe-coded a clone app — pixlpa · 2026-10-09
- Annoyed by 30s Plex Load, One Redditor Rebuilt a Native LG TV Client With Claude Code — eherrerosj · 2026-10-09