kohya's kv-cache Control LoRA Implementation Cuts MOSS-Image Overhead to Half of Concat

bdsqlsz · x · 2026-10-27

kohya (of sd-scripts fame) shared a new implementation of MOSS-Image Control LoRA using a kv-cache approach: inference overhead drops to about half of the concat method, only 20% slower than vanilla inference. He also trained gates alongside it, enabling per-block on/off switching that brings overhead down to 10% above baseline.

Original post →

More from Multimodal

Multimodal channel →