HKU Open-Sources PhoneGo, a CLI+GUI Hybrid Phone Agent Cutting Steps by 47% and Latency by 56%
aigclink · x · 2026-11-20
HKU researchers open-source PhoneGo, an agent that installs directly on Android and completes cross-app tasks from natural language — e.g., searching Xiaohongshu for hotels near HKU, extracting names, then auto-switching to Ctrip to check the same hotels' prices.
Headline numbers: vs pure-vision phone agents, 47% fewer operation steps, 56% less execution time, 55% fewer tokens.
Core design — CLI+GUI hybrid execution:
- Offline exploration builds an App Navigation Map, compiling pages and routes into executable commands
- Online, the agent prioritizes known commands instead of screenshot-guessing every step
- A vision model takes over only for unknown pages, dynamic content, or anomalies
- Cross-app handoff passes information between apps for continuous tasks
Apps run in a virtual screen without disrupting normal phone use. Requires Android 14+/ARM64; APK available; bring your own model API key; operates via wireless debugging and accessibility services.
Related event: HKU Open-Sources PhoneGo, a Natural-Language Android Agent(2 posts)→
More from coding & agent
- Cognition: Gemini 4 Neon scores 46.2% on FrontierCode 2.0, near Opus 5.5 at 1/3 cost — scaling01 · 2026-11-20
- Anthropic's AI code review: real-issue detection jumped from 16% to 54% — dotey · 2026-11-20
- Modular rebuilds MAX's Module API with PyTorch-like syntax and eager mode — clattner_llvm · 2026-11-20
- Apple reportedly building an AI agent that controls devices, browses the web, and codes — Polymarket · 2026-11-20
- comfy-ts: open-source typed ComfyUI workflows for humans and coding agents — rvion · 2026-11-20
- Feedbacker Adds MR-Style Inline Code Review to Claude Code and MCP Agents — JeremyCMorgan · 2026-11-20