NVIDIA releases Cosmos Simulation: real-time interactive world models for Physical AI
CSProfKGD · x · 2026-10-22
NVIDIA Cosmos Lab unveiled Cosmos Simulation, turning Cosmos 3 into real-time streaming interactive world models via a single post-training recipe.
- Simulate from actions: Cosmos3-Nano-Sim-Bimanual predicts visual dynamics from camera navigation and robot actions, streaming observations as controls arrive, with synchronized multi-rollout rendering.
- Spatial controls to RGB: Cosmos3-Nano-Sim-Transfer converts depth, segmentation, edges, or blurred video into detailed RGB, with language-steered appearance while physics state is maintained.
- Results: Higher video quality and reference-frame PSNR than DreamDojo 2B/14B on AgiBot-World and AgiBot-GEAR.
Website, technical report, model weights, and GitHub code are all available.
Related event: NVIDIA launches Cosmos 3 real-time interactive world simulation(3 posts)→
More from Embodied
- Tesla Q3 earnings: Musk fields 21 questions on Robotaxi costs, FSD revenue and Optimus — XFreeze · 2026-10-22
- GPT-6 Astra leads Gemini 3.8 Flash 1,349 to 972 on physical agent Elo index — qinzytech · 2026-10-22
- Musk: Tesla needs 10,000-20,000 Optimus bots doing self-play to bootstrap training data — XFreeze · 2026-10-22
- Riding the first production Mercedes shipped with NVIDIA's full self-driving stack — HarperSCarroll · 2026-10-22
- Musk: Austin Cybercab fleet grew 10x in a month as autonomous miles scale exponentially — XFreeze · 2026-10-22
- CMU paper defines solver-sufficient symbols to cut hybrid robot planning cost — Yiyuan Pan · 2026-10-22