Post-caption trick: train LoRA with activation word only, caption at inference
Inevitable_Pen9043 · reddit · 2026-11-20
The author shares an experiment: 1) train a LoRA using only an activation word with no captions; 2) caption one dataset image with JoyCaption; 3) apply that caption at inference. The surprising hint: even without captions in training, the model may still learn the concepts, and you can steer them at inference time.
The author isn't fully sure of the mechanism, but this "post-caption" approach suggests you can skip captioning during training and refine outputs with captions only when generating.
More from Multimodal
- Google ships 8 updates in 2 weeks: Gemini 4 Neon/Hydrogen/Carbon, Genie 4, Robotics 2.5 — GoogleAI · 2026-11-21
- CapCut plugin connects ChatGPT to auto-cut gameplay highlights, then human picks the payoff — iamfakhrealam · 2026-11-21
- Posterior Matching Distillation preserves teacher diversity in few-step generation — ArashVahdat · 2026-11-21
- Qwen3 TTS goes live on Together AI: 9 voices, plain-language control, 10 languages — togethercompute · 2026-11-21
- 3DGS vs Point Cloud comparison looks great; surface reconstruction for sim collisions next — jonstephens85 · 2026-11-21
- AI video showing 25+ celebrities 'before and after' plastic surgery goes viral — evisoft · 2026-11-21