Google open-sources ARTEMIS, an on-device Android GUI agent at 3s per step
aigclink · x · 2026-09-22
Google open-sourced ARTEMIS, a GUI agent that operates real Android devices: it reads the screen, finds controls, taps and swipes across apps, with logging, screenshots, replay and reports.
- Element finding: combines accessibility hierarchy/XML UI trees, OCR and vision models for Canvas/Compose/Flutter UIs, falling back to visual/coordinate taps.
- Long tasks: compresses old screenshots into summaries to avoid context blowup.
- Two modes: Flash (3–5s/step, fast observe-act loop) and Pro (15–40s/step, planning, handles 100+ step tasks).
- MCP-native: plugs into Claude Code, Codex, etc., letting AI drive real-device debugging.
A concrete step forward for mobile testing, debugging and automation.
More from coding & agent
- Google Rolls Out Browser Use to All Antigravity Users, Raising Doubts About Gemini Desktop App — testingcatalog · 2026-11-12
- OpenRouter launches Extractions API: typed JSON field extraction from text, images and PDFs — michellechen · 2026-11-12
- AgenticRL-Bench debuts: best agents pass only 14% of real-world agentic RL tasks — cuijiaxun · 2026-11-12
- SemiAnalysis: Persistent agents now eat 45% of our AI spend, and Perplexity's harness beats Claude Tags — dylan522p · 2026-11-12
- Gemini Agent Spans Workspace, Mobile, Desktop, and Slack via @-Mention — samcharrington · 2026-11-12
- Carbon + /swarm in Antigravity: Big Model Thinks, Lighter Models Work — samcharrington · 2026-11-12