Training Wan 2.1 Video Model with Qwen3-VL Text Encoder
ostrisai · x · 2026-07-05
Open-source developer ostrisai experimented with adapting the video generation model Wan 2.1-1.3B to the Qwen3-VL-2B vision-language text encoder. The training was split equally at 33% each for text, VL, and a mix of both, currently limited to pre-training two linear layers for text input. The developer noted that the model adapts to the new text encoder extremely fast, having completed 25750 steps (BS=10) of training.
More from Multimodal
- TischEins, a large Midjourney SREF library, relaunches with new design after security outage — tisch_eins · 2026-10-26
- MOSS-Image-SFT 4-step distillation tops 16.5K downloads on Hugging Face — _akhaliq · 2026-10-26
- Claude Code can now edit videos: a 10-prompt workflow from raw footage to final cut — TawohAwa · 2026-10-26
- One-sentence 3D worlds turn cinematic with CineMap and TapNow — gizakdag · 2026-10-26
- No Camera Needed: Creator Builds an Entire World in CineMap and Directs It Into Cinema — gizakdag · 2026-10-26
- Kling vs. Seedance: the Chinese AI video model rivalry — DavidmComfort · 2026-10-26