Open-source CLSS streams arbitrarily long audio+video on a 16GB GPU, cutting DiT evals by ~50%
nazgut · reddit · 2026-10-01
Reddit user nazgut shipped a major update to CLSS (Closed-Loop Streaming Synthesis), a ComfyUI toolkit that turns H3 — capped at 5–15s per pass — into an arbitrarily long streaming audio+video generator by overlapping chunks with drift control at the hand-off, no weight changes. It runs on a 16GB card: int8 DiT, a 5.5GB Qwen3-VL-4B text encoder replacing the 15.7GB 32B, 832×480, 10s chunk windows, tested on an RTX 3080 Laptop.
Key additions:
- Multi-scene prompts with proportional allocation, two-step crossfades, shared globaltext.
- R2V per-scene image/audio anchors (<Picture N>/<Audio N>); <Video k> video refs auto-resampled to 24fps with original soundtrack.
- i2v via first-frame keyframe pinning.
- Audio continuity kit: sample-exact seams, waveform-refresh continuation, seam pinning, export-only loudness anchor, loop guard re-rolling vamp takes, equal-power crossfades.
- Continue & re-edit from saved frames/audio, or rebuild single chunks in place.
- Per-chunk neural latent upscaling that never leaves VRAM.
- Spectrum hidden-state forecasting (adapted from the Spectrum paper): forecast steps skip the whole DiT stack, turning a 6-step turbo chunk into A A F A F A — 50% of DiT evals skipped.
- 16GB hardening (unload-all-models, CUDA expandable segments).
Repo: https://github.com/nazgut/ComfyUI-MiniMaxH3-CLSS
More from Multimodal
- Testing Qwen Image 2.1 and Minimax H3 on anime-to-photo conversion and film photo restoration — Ant_6431 · 2026-11-16
- Second take of a 'Cubee run' video generated with Minimax H3 — JahJedi · 2026-11-16
- Non-artist builds 14-chapter hand-painted storybook game with Fable 5.2 in 4 hours — jradoff · 2026-11-16
- Subject LoRAs on Minimax H3 Image learn poor likenesses while identical datasets excel on Qwen 2.1 — Ad_Organic · 2026-11-16
- Seedance-generated anime train scene stuns Reddit with cinematic quality — Ok-Solution-7889 · 2026-11-16
- AI-generated 'Men in Black' reimagined in 1977 goes viral — techhalla · 2026-11-16