HKU team's SceneMosaic generates simulation-ready scene variants 24x faster with near-zero collisions
机器之心 · wechat · 2026-09-28
Scene generation for robot simulation faces a tradeoff: agentic text-to-3D is slow (SAGE takes 7.56 hours per scene) while parametric image-to-3D is fast but physically unreliable (20-26% collision rates). A team from the University of Hong Kong proposes SceneMosaic, open-sourced, addressing speed, physics, and diversity.
Method:
- Reconstruct scenes with SAM3 + SAM3D into a hierarchical "scene tree" with independently evolvable local units (e.g., bookshelf + books)
- Physics-first pipeline: containment correction and gravity simulation before a Critic-Actor loop where the Critic gives qualitative advice and the Actor resolves symbolic pose expressions precisely
- Diversity via Cartesian product of local variants, then Max-Min greedy search with novelty distance
Results: On SceneEval-100, semantic quality matches the best baseline (POS 84.3 vs 83.5), 24x faster than SceneSmith, and a variant scene costs only 0.03 hours. Relation retention is 99.1% vs 71.5% for Gaussian perturbation at equal diversity.
Limitation: relies on a single input image, so currently room-scale only.
More from Embodied
- YC-backed Ornadyne's flapping-wing drone was classified as a bird by Air Force detectors — import_jmr · 2026-11-16
- Uber starts offering Amazon's Zoox robotaxi rides in Las Vegas — Polymarket · 2026-11-16
- Ant Lingbo Embodied AI Challenge crowns TARS team after 48-hour real-robot hackathon — 新智元 · 2026-11-16
- Tesla FSD fleet tops 7 billion city miles, adding ~500M in under four weeks — XFreeze · 2026-11-16
- Ropedia Releases Xperience 2: 1,500+ Scanned Real-World Scenes Paired With Egocentric Demos — liuziwei7 · 2026-11-16
- Hangzhou's Manycore Tech launches Aholo MS07 3D laser scanner with CHCNAV — teortaxesTex · 2026-11-16