Scene-Designer: Critic-guided GRPO teaches agents 3D scene design intelligence

OmniAI-ZJU · hf · 2026-10-19

Zhejiang University's OmniAI Lab introduced Scene-Designer, an agentic framework generating complete, coherent, usable 3D indoor scenes from natural language. It builds two datasets — Scene-OTA-35K (Observation-Thought-Action supervision for design and error correction) and Scene-OTC-15K (Observation-Thought-Critic supervision for critiquing physical validity, functional correctness, layout coherence) — and proposes Scene-GRPO, a Critic-guided GRPO framework that improves design decisions and cuts trial-and-error. It outperforms prior methods on all three metrics; the learned Scene-Critic beats general-purpose models and boosts generation at test time, with design and critique abilities mutually reinforcing.

Original post →

More from Multimodal

Multimodal channel →