Gradio Distills Qwen-Image 2.1's 9B Prompt Rewriter Down to 0.8B for Laptops

Gradio · x · 2026-09-23

Qwen-Image 2.1 draws best when a 9B prompt rewriter expands your request first — 20GB in bf16, a 1,700-word system prompt, and 1,600 thinking tokens. Gradio distilled it to 0.8B that fits on a laptop. Follow-ups: built end-to-end by ML-Intern in HuggingChat; models, the 8,797-request dataset with teacher thinking traces, all eval predictions, and training/eval code are open under the non-commercial Qwen Research License.

Related event: Gradio Open-Sources Distilled Qwen Prompt Rewriter Down to 0.8B(3 posts)→

Original post →

More from Multimodal

Multimodal channel →