HKUST Guangzhou and Tencent open-source VibeWorlding, an agent framework for building 3D worlds by chat
jiqizhixin · x · 2026-09-04
HKUST Guangzhou and Tencent AI Platform released VibeWorlding, a multimodal agent framework that builds interactive 3D worlds end-to-end via natural language — like vibe coding for 3D.
- Building 3D worlds still demands pro skills in asset retrieval, placement, collision avoidance, and rendering; existing agent frameworks are either rigid fixed pipelines or closed-source, with benchmarks too simple for real users' vague, contradictory requests
- VibeWorlding handles asset search, object placement, collision checking, and render verification through multi-turn dialogue, tool calls, and visual feedback — say "build a creepy desert temple" or "move that chair two meters forward"
- The team also open-sourced VWE-Bench, designed for realistic, messy user queries
- Claimed as the first fully open-source framework and benchmark for end-to-end 3D world construction
More from coding & agent
- Sakana AI's Stefania Druga demos agentic memory experiments for edge devices — kaixhin · 2026-09-04
- DeepMind's Prateek Jain on MatFormer: agents that dial compute up or down by task difficulty — jainprateek_ · 2026-09-04
- rybbit-mcp lets Claude Code query Rybbit Analytics via natural language — modelcontextprotocol · 2026-09-04
- Agentic Coding's Biggest Flaw: Managing AI's Pointless Code Rewrites — kylegawley · 2026-09-04
- Anthropic reveals 3 Claude sandbox escapes, one touched a production database — Sumsub_Insights · 2026-09-04
- Subagents when the API key hits the rate limit — realsohamparekh · 2026-09-04