CG-World Releases 850k-Segment CG Dataset to Reshape World Models with Counterfactuals
TheTuringPost · x · 2026-08-01
Existing video and robotics datasets often capture only partial physical structures, making it difficult to train truly usable world models. To address this, CG-World introduces a new data protocol based on industrial computer graphics (CG), treating pixels as observations generated by an underlying state.
The v1 dataset contains approximately 850,000 temporally aligned segments of 1-5 seconds. Beyond RGB alignment, it comprehensively records object geometry, actions, contact events, and physics states.
Its core innovation lies in introducing counterfactual branches: starting from the same initial state, it records alternative outcomes by altering a single variable such as action, mass, or friction. This design shifts the focus of world models from merely "predicting the next frame" to "understanding how interventions alter underlying states." While it includes 5,000 action and 5,000 mechanism branches, the full raw data currently requires controlled access due to industrial constraints.
Related event: CG-World Releases 850k Dataset to Reshape World Models(2 posts)→
More from Embodied
- Humanoid Robot Dodges 19/20 Thrown Balls Using Onboard Sensors — ChongZzZhang · 2026-08-01
- ACE-Data-0: A Large-Scale Multimodal Dataset for Embodied AI — liuziwei7 · 2026-08-01
- Tesla FSD Drives Hundreds of Miles, Self-Corrects Single Off-Ramp Mistake — Scobleizer · 2026-08-01
- California Startup Develops 2-Meter Centaur Robot for Wildfire Rescue — SydSteyerhart · 2026-08-01
- AI Makes Call of Duty Heartbeat Sensor Real: Sensing the Physical World via RF — bilawalsidhu · 2026-08-01
- VLM run Integrates Gemini Robotics ER 2 into Orion 2 Visual Agent Harness — spillai · 2026-08-01