Seedream team unveils VoT: visual reasoning branch plans images before diffusion renders pixels
JingxiangSun42 · x · 2026-09-13
The ByteDance Seedream team introduces VoT: Vision-of-Thought for Unified Multimodal Representation Alignment, extending MoT into three branches — Text, VoT, and Diffusion — with key-value pairs from all branches concatenated for unified attention.
For text-to-image and image-to-image generation, the VoT branch between the VLM and DiT first predicts discrete visual tokens as semantic plans ("visual thinking before rendering pixels"), then the diffusion branch jointly attends to the text and VoT key-value pairs to synthesize the final image.
Related event: ByteDance Seedream Team Introduces VoT: Thinking Before Rendering(3 posts)→
More from Multimodal
- 10-Person Startup Phonic Claims #1 on Five Speech Benchmarks With Phonic-1 — graceisford · 2026-10-31
- Halloween doorway: Midjourney prompt builds a giant moth crossing a star-forest cliff — tisch_eins · 2026-10-31
- Open-source ComfyUI Motion Previs Studio brings 3D camera blocking to AI video — navarisun · 2026-10-31
- Open-Source ComfyUI Motion Previs Studio Blocks 3D Shots Before Video Generation — navarisun · 2026-10-31
- Hooking Mage's MCP into Claude generated narrative image sets in one shot — AIandDesign · 2026-10-31
- At 3 am she stops scrolling and a whole town answers in songs — AI short film — ownubie · 2026-10-31