Gradio distills Qwen's 9B prompt rewriter into an 812MB 0.8B model that fits a laptop
Gradio · x · 2026-09-23
Gradio released Qwen-Image-2.1-PE-T2I-Pocket, distilling Qwen-Image 2.1's official 9B prompt rewriter into 2B and 0.8B student models.
- The original 9B rewriter runs 20GB in bf16, uses a 1,700-word system prompt, and thinks for 1,600 tokens before answering. The 0.8B student needs no system prompt and no thinking — it goes straight to the JSON the image model wants in 450 tokens (28% of the teacher's), and ships as an 812MB GGUF that fits on a laptop.
- The whole pipeline was run end to end by an ML-Intern agent in HuggingChat: it wrote 8,797 requests in 18 languages, labeled them with the 9B teacher, trained both students with TRL, evaluated on text and rendered images, and pushed everything to the Hub. Humans only approved the budget and read the report.
Weights are open on Hugging Face under ML-Intern-lab.
Related event: Gradio Distills Qwen's 9B Prompt Rewriter to 0.8B, Fully Open-Sources It(4 posts)→
More from coding & agent
- Interactions Tool Searches Web Animations by Motion for Claude Code to Rebuild — yuwen_lu_ · 2026-11-12
- Agent Substrate Calculator Estimates Session Resume Speed Under Load — pjausovec · 2026-11-12
- Senate Bill Would Force Big Platforms to Accept AI Agents, Raising Auth Privacy Questions — Prof_CarlaReyes · 2026-11-12
- A Swarm of Claudes Built Its Own Video Editor and Cut NASA Footage Overnight — zealcaiden · 2026-11-12
- Dell expands AI Data Platform: agents have a data-context problem, not a model problem — DavidLinthicum · 2026-11-12
- Google Antigravity Adds Agentic Browser Use; Shipping Velocity Improving — petergyang · 2026-11-12