TreeAdapter Integrates 10,000+ LoRAs into a Single 4B Model System

bdsqlsz · x · 2026-08-06

DiffSynth-Studio introduced TreeAdapter, a novel project exploring LoRA as a modular building block for model systems. Built on a 4B open-source backbone, it successfully integrates over 10,000 LoRAs into a single model system.

TreeAdapter allocates LoRAs by content, organizing them along a biological taxonomy and composing only the relevant path during inference. This architecture leads on FID, CLIP, and BioCLIP across three biodiversity benchmarks and generates rare species more faithfully than GPT-Image-2.

The project also highlighted MultiAlign, another technique allocating MoE LoRA by timestep to improve instruction following, text rendering, and aesthetics throughout the denoising process.

Original post →

More from Multimodal

Multimodal channel →