VDN-H3 ported to Vpipe hits ~2.6x faster H3 generation on M5 Pro 24GB
TgoAI · reddit · 2026-09-07
The author ported VDN-H3 (Video DeltaNet for MiniMax H3) to Vpipe, a native C++20/Metal inference runtime for Apple Silicon (no PyTorch/MPS/MLX), in about a day.
Results:
- Speedup scales with length and resolution: at 832×480 it pulls ahead around 6s reaching 1.7× at 15s; at 1344×768 the crossover comes earlier with 2.6× at 14s (6 DiT steps + Turbo LoRA)
- Reference points: FastH3 needs 465–504s on M4 Max 36GB for the same spec; Vpipe's baseline H3 without VDN cold-starts at 469s on a 16GB M5 MacBook Air
Approach & costs: VDN exploits inherent redundancy in video diffusion rather than applying compute uniformly, using a hybrid frame-wise linear-attention + softmax-attention architecture. Tradeoff: 4GB of non-fusable extra weights plus 1GB potentially fusable LoRA-style (not yet implemented); on 24GB machines this can outweigh compute savings for small workloads. 8-bit quantization of incremental weights is a future optimization.
Quality: compositions closely match baseline with the same seed, but some sequences show long-range temporal inconsistencies (e.g., water flow reversing), likely tied to sliding-window/linear attention; mixing in global attention may help. Reference conditioning (first/last-frame) remains open.
More from Infra
- DEX-Comp Compresses RAG Context 16x While Matching or Beating Uncompressed Baselines — _reachsumit · 2026-09-07
- Embedding Surgery: query-time localized vector edits fix dense retrieval rankings, +60% nDCG@10 — _reachsumit · 2026-09-07
- SC Asia 2027 opens call for papers on supercomputing and AI infra, due Oct 7, 2026 — thoefler · 2026-09-07
- Ex-Google Brain researcher: key algorithmic wins were found under 1e20 FLOPs, then scaled to 1e25 — _arohan_ · 2026-09-07
- Hands-on test: AI ops agent Ghost diagnoses and fixes three simultaneous service failures — BLUECOW009 · 2026-09-07
- Guide: Run DLSS 5 Real-Time Video Playback on RTX 20/30 Series via MPV — Miserable-Option5488 · 2026-09-07