HKUST-GZ and Tencent open-source VibeWorlding, an agent that builds interactive 3D worlds from natural language
jiqizhixin · x · 2026-09-04
HKUST Guangzhou and Tencent AI Platform released VibeWorlding, a multimodal agent framework that builds interactive 3D worlds end-to-end — vibe coding for 3D.
- Motivation: building 3D worlds still demands specialized skills in asset retrieval, placement, collision avoidance, and rendering; existing agent frameworks use rigid fixed pipelines or closed-source systems, and their benchmarks are too simple to reflect real users' vague, contradictory requests.
- How it works: users give natural-language instructions like "build a creepy desert temple" or "move that chair two meters forward"; the agent handles asset search, object placement, collision checking, and render verification via multi-turn dialogue, tool calls, and visual feedback.
- Open source: the team also released VWE-Bench, a benchmark built around realistic, messy user queries — the first fully open-source framework and benchmark for end-to-end 3D world construction.
More from coding & agent
- Librarian Agents: RL-trained agents build file systems, lifting RAG accuracy 44%→77% — simonguozirui · 2026-10-21
- Slack's first employee: living specs as source of truth, AI agents maintain the docs — josh_wills · 2026-10-21
- SpaceX support uses Grok Bot to clear 204 tickets in ~10 minutes — XFreeze · 2026-10-21
- GitHub Copilot's HydraFusion Orchestrates Multiple Models Per Task — WirelessLife · 2026-10-21
- Nous Research's Hermes now launches Cua Spaces for computer-use agents — alexcovo_eth · 2026-10-21
- Headlong from Laude's Slingshots batch is a microharness for persistent agents — lateinteraction · 2026-10-21