Seedream team unveils VoT: visual reasoning branch plans images before diffusion renders pixels
JingxiangSun42 · x · 2026-09-13
The ByteDance Seedream team introduces VoT: Vision-of-Thought for Unified Multimodal Representation Alignment, extending MoT into three branches — Text, VoT, and Diffusion — with key-value pairs from all branches concatenated for unified attention.
For text-to-image and image-to-image generation, the VoT branch between the VLM and DiT first predicts discrete visual tokens as semantic plans ("visual thinking before rendering pixels"), then the diffusion branch jointly attends to the text and VoT key-value pairs to synthesize the final image.
Related event: ByteDance Seedream Team Introduces VoT: Thinking Before Rendering(3 posts)→
More from Multimodal
- NVIDIA open-sources NemotronLabs RE-USE, a 9.6M-param multilingual speech denoiser — NVIDIAAI · 2026-10-31
- AI-generated fake trailer imagines a 1999 Dino Crisis movie with retro VHS feel — noizlab_studio · 2026-10-31
- Spatial Hub aggregates ~5000 public COLMAP-compatible spatial datasets for world models — janusch_patas · 2026-10-31
- Single image to walkable 3D Gaussian splat scene using World Labs Atlas and WebGPU — XRarchitect · 2026-10-31
- AI video reimagines Suicide Squad's Joker as a rapper in a full music-video treatment — Silver_War5476 · 2026-10-31
- 60+ community-made ChatGPT slash-style words turn one word into a full visual style — heyshrutimishra · 2026-10-31