Stanford removes the decoder: direct pixel prediction from diffusion transformers cuts cost, lifts quality
StanfordUniversity · hf · 2026-11-19
Stanford (with Luma AI and Caltech) presents "Decoding Without a Decoder": by adding a final-step prediction head to a finetuned diffusion transformer, the method predicts pixels directly from the DiT, removing the decoder from latent diffusion models.
The approach reduces inference cost while improving pixel-level quality in both image and video generation; paper figures show the decoder-free DWD results beating baselines on Wan2.1 14B video latent diffusion and T2I pixel diffusion (e.g., sharper signage text).
More from Multimodal
- Tsinghua-led ALIVE makes streaming video models interactive with proactive monitoring and feedback-seeking — Tsinghua · 2026-11-19
- AnisoFlow learns anisotropic prediction targets for flow models, boosting FID without touching architecture — StanfordUniversity · 2026-11-19
- Bypassing PyTorch with HIP kernels makes MiniMax H3 up to 3x faster on AMD R9700 — Apprehensive_Sky892 · 2026-11-19
- User tests Thinking Machines' Inkling on living bacteria colony visual design — simonguozirui · 2026-11-19
- One prompt, a 4-minute video: Grok bot's video generation impresses — songguoxiansen · 2026-11-19
- ComfyUI Help: How to Pose Chibi, Short-Legged Characters with OpenPose Skeletons? — Any_Aardvark_9324 · 2026-11-19