Advanced FLUX.2 ControlNet Workflow: How Prompts and Reference Images Compete
jessidollPix · reddit · 2026-08-09
The author shares a FLUX.2 ControlNet experimental workflow built on their custom JLC Flux2 ControlNet node package, exploring how prompts, reference images, and ControlNet signals interact during generation.
Key Experiments & Findings
- Signal Competition: These three conditioning streams can reinforce each other, but more conditioning isn't always better—especially when a strong prompt, multiple references, and dense ControlNet hints demand conflicting results.
- Style Comparison: By keeping the same seed and composition but switching reference image families and matching style prompts, the rendering domain shifts dramatically (e.g., from a stylized doll look to photorealistic skin textures).
- Hand Stabilization Trick: Using Depth Anything (0.95 strength) for main geometry combined with a tiny amount of DWPose (hand detection only, 0.01 strength) is sufficient to stabilize hands, avoiding the artifacts often caused by high DWPose strength.
VRAM & Cache Optimization
To handle high resolutions, multiple references, and dense hints on a 16GB GPU, the workflow introduces a two-pass cache mode: prewarming the cache for references/ControlNet maps before running the normal generation queue. This avoids repeated VAE preparation, while a post-sampling VRAM cleanup node unloads the diffusion model to free memory.
More from Multimodal
- Kling 4.0 fully available, shows markedly better motion coherence in fast-action scenes — alifcoder · 2026-10-16
- MJev-Spatial: Single-Pass Classification Beats Autoregressive VLMs on Spatial Reasoning — mindlab-research · 2026-10-16
- H-DDCM: Hadamard Codebooks Make Diffusion-Based Image and Video Compression Scalable — Technion · 2026-10-16
- ComfyUI v0.41.0 ships with Flux3 image model and MiniMax-H3 LightVAE support — Fcking_Chuck · 2026-10-16
- AI-generated short film 'The Dragon Rider' glides cinematically above the clouds — jijo6686 · 2026-10-16
- Realistic candid Midjourney portrait prompt: natural skin, lived-in bedroom light — tisch_eins · 2026-10-16