ComfyUI INT8 LoRA quantizer cuts LoRA disk size by 50-75%
BakaPotatoLord · reddit · 2026-11-20
A Redditor released ComfyUI-INT8-LoRA, an open-source custom node pack that stores LoRA/LoKr files as INT8 to save disk space, decoding in memory at load time. FP32 LoRAs shrink 75% and BF16/FP16 50% — e.g. an 8-step MOSS LoRA went from 1134 MiB to 284 MiB. It ships nodes for single-file and folder quantization plus an INT8 LoRA loader (with 3-stack option), and a default 'auto' method that tries INT8 and INT8 ConvRot, keeping whichever has lower error. Caveats: it saves storage, not RAM/VRAM, and only MOSS and Anima adapters have been tested; repeated generations stay highly similar with occasional minor detail changes.
More from Infra
- Baseten breaks down its security threat model as agent swarms accelerate attacks — baseten · 2026-11-21
- Nvidia's rivals are vying to be the 'Central Bank' of AI, says investor — GavinSBaker · 2026-11-21
- Benchmarking 11 open models' post-GQA attention: up to 139x less memory at 128K — bariskasikci · 2026-11-21
- Anthropic files for Nasdaq IPO — why you should keep a local open-source LLM as backup — alex_verem · 2026-11-21
- Microsoft launches MAI Licensed Weights; Purdue researcher asks to run them on own hardware — marlene_zw · 2026-11-21
- Looped CED cuts KV-cache memory 36.8x on 552B model, but encoder loops cost compute — teortaxesTex · 2026-11-21