Making ComfyUI's INT8 Faster on ROCm
Itchy_Push_3077 · reddit · 2026-07-19
This is a highly specific ComfyUI / AMD ROCm performance optimization guide, aiming to make Krea2 Turbo's INT8 ConvRot run faster on AMD cards.
The author first compares three paths:
- FP8: Stable, warm start around 12.74s
- INT8 ConvRot safe fallback: Stable but very slow, around 65–80s
- Global Triton: Attempts a fast path, but crashes on ROCm
Instead of enabling Global Triton, the author only switches the int8linear path of ConvRot to a Triton implementation, leaving the rest on the stable path. This avoids crashes caused by global enabling while retaining the acceleration of critical operators.
The results:
- Warm start improved from FP8's 12.74s to 10.49–10.54s
- About 6–7.6x speedup compared to the original INT8 fallback path
This type of post is highly valuable for local AMD/ROCm deployment users.
More from Infra
- How to build a PostgreSQL-backed semantic search pipeline with pgvector and Ollama — KhuyenTran16 · 2026-07-21
- NeurIPS 2026 workshop calls papers on on-device intelligence — YiMaTweets · 2026-07-21
- Milled from Solid Aluminum: AI Rig Multi-GPU Case for Local Compute — dee_hw · 2026-07-21
- FutureCaribbean’s Buildathon offers $50K, H200 compute, and an NYSE pitch — HeyAmit_ · 2026-07-21
- A new series tests which data-science workflows can run on GPUs today — pandeyparul · 2026-07-21
- Former AWS operator says Bedrock margins can beat SageMaker as agentic AI lifts CPU demand — RihardJarc · 2026-07-21