Animating AI-generated 2D game art with FLUX.2 klein: masked redraws work but remain a hack
emilrueh · reddit · 2026-11-16
- The author builds a 2D game that generates art on the fly with FLUX.2 klein 4B plus an illustrator-style LoRA, needing cheap looping frames for fire, smoke, and steam.
- Approach 1 (prompted motion per frame) produced unnatural swings and redrawn backgrounds; Approach 2 uses a vision model to output pixel coordinates, builds a mask, and redraws with the same prompt and a new seed so only masked regions change — it works, but mask edges show when redraws misalign and objects like candles flicker entirely.
- The pipeline is already costly: every frame is drawn twice (white and black backgrounds) to solve transparency via difference.
- Open questions: improve masked prompting, or pivot to image-to-video — does transparent video exist, can it run fast/cheap enough for near-live loops, keep the LoRA style, and license for commercial use? Shader alternatives welcome.
More from Multimodal
- Vivix W1 video model: 100 ten-second ads for about $5 at $0.005 per second — Aiden_Tech_Ai · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Reddit megathread crowdsources the best open-source audio models: ASR, TTS, and text-to-music — rm-rf-rm · 2026-11-16
- Hand-editing 0.2% of weights plus 100 CPU-minutes turns an English TTS model into an 18MB Sanskrit one — kastnerkyle · 2026-11-16
- Zyphra open-sources textnorm tool, lifting TTS structured-data accuracy by up to 22 points — kastnerkyle · 2026-11-16
- AI music video tells a racing driver's comeback story — VictoryVisualsStudio · 2026-11-16