NVIDIA shows frontier AI agents building Omniverse simulations from natural language
nordicinst · x · 2026-10-09
NVIDIA's blog walks through how developers combine frontier AI models like GPT-6 Astra with Omniverse libraries to build simulation apps via natural-language instructions — assembling assets, wiring physics and rendering, and validating scene behavior.
Highlights:
- Humanoid warehouse simulator: product manager Frank DeLise used Astra to turn a SimReady warehouse and humanoid robot into an interactive simulator with first-/third-person views, auto-connecting the physics (ovphysx), scene (ovstage), rendering (ovrtx), and UI (ovui) libraries
- Applications target scenario exploration, failure investigation, and design improvement, backed by GPU-accelerated physics, rendering, and sensor simulation
The post previews an agent-driven, natural-language workflow for simulation development, useful for evaluating task behavior before automating warehouse work.
More from Embodied
- Open-Source Models Power Home Robot Tidying for Toddlers in Weeks, Not Years — chris_j_paxton · 2026-10-09
- Sony's quadruped walks on cracked pavement with passive-stability spherical feet — BLUECOW009 · 2026-10-09
- OpenAI's new Decisions API with image input tested on a MuJoCo robotics policy — RexDouglass · 2026-10-09
- TraceExtract open-sourced: data engine for µ0 world model trained on video with zero action labels — RexDouglass · 2026-10-09
- Robot fight tickets sell out in under 24 hours — cixliv · 2026-10-09
- Ditto-Bench stress-tests GPT-6 Astra for robot control: simple tasks shine, physics stalls — anand_bhattad · 2026-10-09