NVIDIA Cosmos recipes turn depth video into RGB scenes for robot and AV training

NVIDIAAI · x · 2026-11-03

NVIDIA released new Cosmos simulation recipes that convert depth video into detailed RGB video, changing lighting, textures and backgrounds while preserving geometry and motion — e.g. turning a daytime drive into a rainy night with identical road layout and vehicle trajectories.

The recipes help developers generate training data and test policies for autonomous vehicles, robots, and even surgical applications.

The accompanying cosmos-framework is open-sourced on GitHub (595 stars), providing inference and training tooling, with checkpoints and recipes available for direct use.

Related event: NVIDIA Releases Cosmos Simulation Recipes and World Model Framework(4 posts)→

Original post →

More from Embodied

Embodied channel →