LoRA Training with SAM 3D for Accurate Full-Body Proportions
tekprodfx16 · reddit · 2026-07-14
A developer forked the AI Toolkit project and integrated Meta's SAM 3D Body model, solving the issue of body type drift (height, proportions) during standard LoRA training for full-body generations.
Training Mechanism:
- Phase 1 (200 steps): Standard LoRA/LoKr training based solely on reference photos.
- Phase 2 (15-60 steps): After image generation, SAM 3D scans the body types of both generated and reference images, using a loss function to force the LoRA to learn the real person's 3D physical characteristics (rather than just guessing from text descriptions).
Performance & Compatibility:
- On an RTX 5090, training just the face takes 30 minutes; adding 3D body scanning takes 60 minutes.
- Currently supports the Krea 2 model; Ideogram 4 support is in development.
The author has open-sourced the project, significantly improving the realism and consistency of full-body character generations in AI art.
Related event: Enhancing LoRA Training with SAM 3D for Accurate Body Shapes(2 posts)→
More from Multimodal
- AI video is a new medium, not cinema or animation — and it's perfect for depicting dreams — Kyrannio · 2026-10-27
- Dad turns his toddler's 31-year-old quote into a song via SUNO kids' choir — NathanpmYoung · 2026-10-27
- Band's local-AI music video hits 200k views: 900 generations kept 64, 3-second clips beat face drift — Hwang0500 · 2026-10-27
- Adobe Firefly video editor walkthrough: one-sentence Quick Cut turns 32s into 20s — LudovicCreator · 2026-10-26
- Hi3D V1.0 open-sourced with 2M training assets and 90% slicing success rate — kimmonismus · 2026-10-26
- Claude Can Replace Your YouTube Thumbnail Designer in 10 Minutes — thedankoe · 2026-10-26