Struggling with LoRA dataset prep for realistic virtual influencer: balancing overfitting and consistency

Capable-Swim318 · reddit · 2026-09-01

A user training a LoRA for a realistic virtual influencer in ComfyUI seeks advice on dataset preparation. The core conflict lies in balancing consistency and diversity: keeping clothing and backgrounds constant risks the model overfitting to these features as part of the identity, while using AI editing to diversify them results in a loss of realism and character consistency. The user used Qwen-Image-Edit to generate variations but encountered a 'plastic' AI look. They are looking for workflows and strategies on how much variation to include and how to maintain character fidelity during training.

Original post →

More from Multimodal

Multimodal channel →