LoRA Training with SAM 3D for Accurate Full-Body Proportions
tekprodfx16 · reddit · 2026-07-14
A developer forked the AI Toolkit project and integrated Meta's SAM 3D Body model, solving the issue of body type drift (height, proportions) during standard LoRA training for full-body generations.
Training Mechanism:
- Phase 1 (200 steps): Standard LoRA/LoKr training based solely on reference photos.
- Phase 2 (15-60 steps): After image generation, SAM 3D scans the body types of both generated and reference images, using a loss function to force the LoRA to learn the real person's 3D physical characteristics (rather than just guessing from text descriptions).
Performance & Compatibility:
- On an RTX 5090, training just the face takes 30 minutes; adding 3D body scanning takes 60 minutes.
- Currently supports the Krea 2 model; Ideogram 4 support is in development.
The author has open-sourced the project, significantly improving the realism and consistency of full-body character generations in AI art.
Related event: Enhancing LoRA Training with SAM 3D for Accurate Body Shapes(2 posts)→
More from Multimodal
- MiniMax H3 MAX nails cooking anime clips: 15-second curry demo with prompts shared — Hailuo_AI · 2026-09-11
- Using a finisher move on one mosquito with MiniMax H3 MAX — the bug survives — Hailuo_AI · 2026-09-11
- Skyfall GS Uses Flux to Refine Gaussian Splatting, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11
- Lumara AI Film Festival Comes to NYC Oct 26, Top AI Filmmakers to Compete — 0xAllen_ · 2026-09-11
- Pterodactyl Detective: An AI-Generated Proof-of-Concept Trailer — PterodactylDetective · 2026-09-11
- Imperium Game Trailer Showcases AI Video Generation — keaslenyt · 2026-09-11