Gradio shrinks Qwen-Image 2.1's 9B prompt rewriter to 0.8B that runs on laptops

Gradio · x · 2026-09-23

The Gradio team found that Qwen-Image 2.1 draws its best images only after a 9B "prompt rewriter" expands your request: 20 GB in bf16, a 1,700-word system prompt, and 1,600 thinking tokens per answer. They compressed it to 0.8B so it fits on a laptop, publishing the details in a thread.

Related event: Gradio Distills Qwen's 9B Prompt Rewriter to 0.8B, Fully Open-Sources It(4 posts)→

Original post →

More from Multimodal

Multimodal channel →