Marigold V2 arrives as Qwen-Video-Edit repurposes an image editing DiT for video
AntonObukhov1 · x · 2026-09-10
Two related research drops: Marigold V2 (SIGGRAPH Asia 2026) upgrades the single-GPU depth-estimation post-training trick to a diffusion transformer with sharper edges and more versatility, while Qwen-Video-Edit enables instruction-based video editing without any video-pretrained model — it teaches Qwen-Image-Edit's DiT to edit Wan 2.1 video-VAE latents directly via small in/out projections, tiling latent frames into one virtual image with grid RoPE.
Trained with LoRA or full fine-tuning on Ditto-1M (source, edited, instruction) triplets and refined with Wan 2.2 denoising, it supports long-video multi-instruction editing and portrait videos natively.
Related event: Marigold V2: A Single-GPU DiT Depth Estimator Hits SIGGRAPH Asia 2026(11 posts)→
More from Multimodal
- MOSS Image Edit vs Fibo-2.0-edit: 5-grid comparison of instruction-based image editing — Illustrious_Row_9971 · 2026-10-27
- Cinematic title sequence built with ComfyUI: LTX-2.5 + MiniMax H3 image-to-video — magratheya_64 · 2026-10-27
- Fish Audio ships open-weight Drama 3 TTS; creator shows turning old posts into narrated videos — alex_verem · 2026-10-27
- Redditor crafts photorealistic 'morning bus ride' short film entirely in ComfyUI — no3us · 2026-10-27
- New blur/anti-blur slider LoRA for MOSS lets you dial background sharpness with weights — NoMouse9610 · 2026-10-27
- PixGR: Pixel-space generative decoding for fast feed-forward 3D reconstruction — kwangmoo_yi · 2026-10-27