Negative momentum cuts sampler error 11-21% vs dpmpp_2m at same step count
YakovSava · reddit · 2026-11-14
Reddit user YakovSava dissects why dpmppdualsdemomentumized from ComfyUI-Extra-Samplers produces blue blobs on flow models like Anima, and ships fixed samplers.
- The bug isn't momentum: the sampler was written for variance-exploding models; its noise step has wrong variance on flow-matching models (latent std 3-4.5 with eta=1 vs 1.2 expected), plus a 3M correction stacked on an already second-order 2S step and an overwritten r parameter. Verified via an exact port (1e-10 match) with per-component ablations.
- What momentum should be: in the DPM-Solver++ frame it's an EMA of denoised output — positive coefficients act as a low-pass filter (error up to +61% worse), negative coefficients become extrapolation and reduce error, stable only for |m|<1.
- Measurements (Anima, bf16, 15 images, paired bootstrap): deterministic m=-0.6 gives 11-21% lower error than dpmpp2m at equal steps (1.2x fewer steps); damped extrapolation (beta=0.5) beats dpmpp2msde by 7-10% with no color cast; a one-eval-per-step sampler beats dpmppsde by 16-29% at equal NFE.
- Artifacts: node pack with ddimmomentum and dpmpp2msdedamped, plus momentumized variants of 19 samplers (unvalidated; lms/ipndmv versions blow up latents at default strength).
More from Multimodal
- Prediction: Pixar-quality animation will explode, but not from video models — ChrisGPT · 2026-11-14
- "Unbelievable" AI video from creator tupacabra stuns the AI community — LinusEkenstam · 2026-11-14
- Redditor shares optimized ComfyUI workflow for MiniMax H3 Image on a 24GB RTX 3090 — Zetalvx-AI-Lab · 2026-11-14
- Designing a 16-image reference experiment for MiniMax H3 Image room editing — AIdianjiaoshi · 2026-11-14
- 20 gorgeous Western-style paintings (likely AI-generated) going viral — xiaosun86 · 2026-11-14
- Kitten TTS 2 ships three tiny open-source TTS models, smallest just 8MB on CPU — pmttyji · 2026-11-14