Maximizing HunyuanVideo Generation on 24GB VRAM
eesahe · reddit · 2026-08-14
A developer shares their experience pushing the limits of running HunyuanVideo (H3) on a single 24GB VRAM GPU. By using int8convrot weights alongside various hacks, they managed to achieve 0.9 megapixel generation at roughly 11 seconds in length.
However, they are hitting a wall trying to exceed 10 seconds of generation at 1 megapixel on 24GB without transitioning to a w4a8 quantization approach, and they are asking the community for better optimization strategies.
More from Infra
- Developer Releases VRAMDISK: Mounts GPU VRAM as an Ultra-Fast Disk Drive on Windows — lxfater · 2026-08-14
- Micron LTA Becomes Vendor Benchmark, AI Supply Chain Relief Unlikely — Sethwinterroth · 2026-08-14
- Running 128k Context LLMs on a $1300 4x RTX 3060 Server — desexmachina · 2026-08-14
- HBM5 Delayed, HBM4E to Skip Hybrid Bonding: Advanced Packaging Roadmap Shifts — zephyr_z9 · 2026-08-14
- W4A16 Quantization Boosts 30B Model Throughput by 4.5x on RTX 3090 — mitchins-au · 2026-08-14
- Hardcore C99: Running 2.78T Kimi K3 on CPU with 8GB RAM — AutomaticDriver5882 · 2026-08-14