Marigold V2 recipe: 4-bit quantized DiT + rank-128 QLoRA, fine-tuned on one 32GB GPU

AntonObukhov1 · x · 2026-09-09

Marigold V2 keeps unconventional choices that work. V1 pushed depth maps through an image VAE — no business working, but it did. V2 pushes ground-truth depth through DINOv3 and aligns DiT features to it (iREPA-depth). Recipe: take a large pretrained DiT (Qwen-Image-Edit-2509), quantize to 4-bit, add a rank-128 QLoRA, fine-tune on a single 32GB consumer GPU — sensible depth after a few hours, done in a few days, no 80GB cards or multi-node setups. Single-step inference, no OOM at 2K resolution.

Related event: Marigold V2 Released: Single-GPU Fine-tuned DiT for Depth Estimation(5 posts)→

Original post →

More from Infra

Infra channel →