Overcoming RGB Sim-to-Real Gap: Gaussian Splatting Enables Zero-Shot Robot Transfer
ZeYanjie · x · 2026-07-23
Traditional robot RL policies are often trained in synthetic, untextured environments, forcing perceptual policies to rely on depth images due to a manageable sim-to-real gap. Leveraging RGB in simulation has remained an open problem.
Partnering with Niantic and NVIDIA, FlexionAI built a pipeline to address this. They scan real deployment sites with off-the-shelf hardware, reconstruct them into photorealistic Gaussian splats, and run massively parallel RL training. The resulting policies transfer zero-shot to real robots, enabling faster deployment.
More from Embodied
- An AI teaching board was demoed at WAIC 2026 — iamfakhrealam · 2026-07-23
- Maker says their bot’s face is nearly done and the build is moving to PCB design — pramodk73 · 2026-07-23
- Palo Alto robot builders are planning a Sunday show-and-tell meetup — ZeYanjie · 2026-07-23
- ICLR 2024 paper uses LLMs to accelerate RL on 25+ long-horizon robot tasks — rsalakhu · 2026-07-23
- Self-driving electric trucks in China are reshaping logistics — TansuYegen · 2026-07-23
- ByteDance reportedly has a Vision Pro-style headset one-fifth the weight of Apple’s — Scobleizer · 2026-07-23