High school grad builds RGBA VAE for FLUX.2, enabling true transparent image output
Superb_Composer_3389 · reddit · 2026-09-30
A developer fresh out of high school spent months making FLUX.2 Klein output natively transparent images, releasing weights alongside a first-ever paper.
Components:
- RGBA VAE: the FLUX.2 VAE widened to 4 channels and fine-tuned so latents carry alpha.
- Extract-9B: a LoRA for Klein Base 9B that takes a photo plus the empty background and returns the object as a transparent PNG, keeping soft shadows semi-transparent.
- Remove-9B: an object-removal LoRA that chains with Extract, requiring only a brush over the object.
Numbers (small test set): Extract-9B hits IoU 0.934 on 20 held-out objects, identical scores at 6 vs 25 steps (11 s/image, 10 GB VRAM in fp8). The RGBA VAE costs 10–18% colour error vs stock — the price of fitting alpha.
Limitations: Remove-9B struggles with flat graphics; no tests above 512². An extractor trained on Qwen-Image-2.1 matches accuracy, runs faster, but needs two GPUs; the paper compares them (author favors Qwen).
Weights are on Hugging Face under a non-commercial licence, with a Gradio demo. Credits AlphaVAE and ostris' ai-toolkit.
More from Multimodal
- Testing Qwen Image 2.1 and Minimax H3 on anime-to-photo conversion and film photo restoration — Ant_6431 · 2026-11-16
- Second take of a 'Cubee run' video generated with Minimax H3 — JahJedi · 2026-11-16
- Non-artist builds 14-chapter hand-painted storybook game with Fable 5.2 in 4 hours — jradoff · 2026-11-16
- Subject LoRAs on Minimax H3 Image learn poor likenesses while identical datasets excel on Qwen 2.1 — Ad_Organic · 2026-11-16
- Seedance-generated anime train scene stuns Reddit with cinematic quality — Ok-Solution-7889 · 2026-11-16
- AI-generated 'Men in Black' reimagined in 1977 goes viral — techhalla · 2026-11-16