Penn's open-source HARMONY rebuilds 3D scenes from one image, matching GPT-6 Astra
thoma_gu · x · 2026-09-24
Researchers at the University of Pennsylvania released HARMONY, an open-source framework that reconstructs compositional 3D scenes from a single indoor image, plus the HARMONY300 benchmark of 300 scenes.
- Hierarchical agentic reasoning: a VLM agent builds scenes like a 3D artist — calibrating the camera, recovering room layout, then placing wall-mounted objects, freestanding furniture, and dependent decorations in order
- Self-reflection loop: after each placement the agent renders and compares against the input image, reflects on errors, and iteratively corrects to prevent error accumulation; depth-first traversal is used for furniture
- Results: even with older VLM backbones, it matches GPT-6 Astra in visual quality while achieving better geometric alignment
Paper, code, data, and benchmark are all open-sourced.
Related event: UPenn Open-Sources HARMONY for Single-Image 3D Scene Reconstruction(3 posts)→
More from Multimodal
- MiniMax H3-Image image model debuts on Tencent's Miora, free to try Nov 11–17 — aziz4ai · 2026-11-11
- MiniMax H3 hits 100 days open-source: 1,472 derivative models, 148M+ downloads — linoy_tsaban · 2026-11-11
- MiniMax H3-Image explodes an espresso machine photo into 15 labeled parts — Charlietest123 · 2026-11-11
- Indie dev built a tool that clips best moments from 4-hour streams in 30 minutes — kissaadams · 2026-11-11
- Non-Blender user makes a video in 30 minutes with Claude and Seedance — FinanceYF5 · 2026-11-11
- Whimsical Woodland: A Watercolor AI Art Prompt Template for Dreamy Forest Scenes — LudovicCreator · 2026-11-11