Alibaba releases Qwen-UI-Agent: 27B model tops 5 of 6 GUI benchmarks, beating GPT-5.6 and Claude Opus 4.8
智东西 · wechat · 2026-08-20
Alibaba has released Qwen-UI-Agent, a GUI agent foundation model for mobile, desktop, web and deep-search environments that operates devices via virtual clicks and CLI execution. It takes first place in 5 of 6 core GUI benchmarks, beating GPT-5.6 Sol, Claude Opus 4.8 and ByteDance's Seed2.1 Pro — with the main version at just 27B parameters (built on Qwen3.5), plus 35B-A3B and 4B variants. It hits 92.2% success on the real-device benchmark MobileWorld-Real.
The key ingredient is a real-device training environment of 100+ physical phones and 150+ apps, with health-aware scheduling and virtual-screen tech boosting concurrent rollout efficiency 20x, directly attacking the sim-to-real gap. GUI, CLI and API calls share one unified action space with batched actions; training uses an SFT → ActionRL → Online RL data flywheel, improving success by 7%+, cutting reasoning tokens 21.3%, and reducing false-success rates 11.2%.
The paper also finds 52% of baseline failures come from real-world interference (pop-up ads, UI misreads) and 40% from execution deficits. For safety, the model refuses high-risk requests outright and pauses for confirmation on payments, data deletion and privacy actions. Technical report and code are public.
Related event: Alibaba Releases Qwen-UI-Agent, Topping 5 of 6 GUI Benchmarks(2 posts)→
More from coding & agent
- Decision models match LLMs on routing and safety — and are 7-8x faster — randal_olson · 2026-10-16
- Temporal Serverless Workers on Cloud Run: queue-driven autoscaling, scale to zero — rseroter · 2026-10-16
- Meta's Superintelligence Lab Runs 200+ Direct Reports—A Lesson for Flat Multi-Agent Systems — peterjliu · 2026-10-16
- LangChain CEO: the most interesting agent harness work lives at the harness-infra boundary — hwchase17 · 2026-10-16
- GitSwarm paper: agents share branchable Git memory, solving all 30 IMOProofBench problems in one run — anirudhg9119 · 2026-10-16
- Hands-on with Gemini 4 Argon: faster than Opus 5.5 but hallucinates more and costs more — prasenx · 2026-10-16