Marigold V2 turns image-editing DiT into single-step depth model, beats SOTA by 16-26%
bdsqlsz · x · 2026-09-14
Marigold V2 (Apache 2.0) adapts a pretrained Qwen-Image-Edit DiT into a single-step dense predictor via lightweight fine-tuning.
- Best zero-shot depth results across comparable-data models; AbsRel improves 16%–26% over prior best on KITTI and ETH3D
- Two-stage iREPA and SinkLoss fix smoothing and flying-pixel artifacts, keeping fur, foliage, and fine wires crisp
- Same framework hits SOTA in depth completion (lowest RMSE on all four benchmarks), see-through depth, surface normals, and intrinsic decomposition
- Training takes under a week on a single 32 GB GPU
More from Multimodal
- AI-generated Doritos USB drive concept mocks design-product photography — Delahuntagram · 2026-10-31
- Krea 2 + H3 morph workflow auto-generates soundtracks via SigLIP2 and Suno MCP — Accurate_Public4674 · 2026-10-31
- Suno ships MCP Beta, dev uses it to sync motion graphics to AI-generated music — enggirlfriend · 2026-10-31
- Mischief launches video model trained from lab-grown brain cells at 0.5¢ per second — evilsocket · 2026-10-31
- A full structured prompt for a 30-second hyper-real horror video sequence — LudovicCreator · 2026-10-31
- Creepy AI horror short made with Seedance 2.5: the abandoned hospital hallway — LudovicCreator · 2026-10-31