Tencent ARC open-sources WorldCrafter, a video world model with implicit 3D-aware memory
yshan2u · x · 2026-09-23
Tencent ARC's WorldCrafter skips explicit 3D reconstruction entirely: the video world model learns an implicit, camera-queryable 3D-aware memory, so pointing the camera anywhere lets the memory fill in the view.
Key insight: the requested viewpoint shapes how multi-view evidence gets compressed into the video generator's limited token budget — a jointly trained memory encoder and pose-conditioned readout produce a fixed set of target-view tokens before denoising, with no explicit depth correspondence. Combined with recent temporal context and few-step distillation, it enables streaming exploration of a scene from a single image or text prompt, with minute-scale horizon consistency and strong camera control.
Weights (base + distilled fast version) are on Hugging Face, code on GitHub, paper at arXiv:2609.24984. Resolution is 384×640 for now, expected to scale.
More from Multimodal
- Izwi: open-source offline voice cloning in Rust, runs on 16GB M1 Pro — zinyando · 2026-11-12
- MiniMax H3 Image generates 3D game scenes in 10s, over 3x faster than GPT Image — HeyToha · 2026-11-12
- Dev releases local world model turning any image into interactive video, runs on RTX 3060 — lucidml_lover · 2026-11-12
- Ex-Meta CV researcher builds AdaL v2, a chat-driven video agent harness for GTM — Scobleizer · 2026-11-12
- MiniMax H3 image gen runs locally on AMD RX 9070, 25-30s per 4MP image — omglionheaded · 2026-11-12
- One reference, one prompt, three image models: side-by-side Nano Banana Pro vs GPT Image 2.6 test — gizakdag · 2026-11-12