Google's Android Bench 2.0: ~30 multi-day engineering tasks to eval long-horizon agents
DynamicWebPaige · x · 2026-10-02
The Android team released Android Bench 2.0, expanding beyond bug fixes and tiny features into complex development work engineers typically spend days to a week on. The eval includes 30 long-horizon tasks: building new apps from scratch, migrating dependencies and designs, and porting cross-platform apps to Android — directly measuring long-horizon coding ability.
More from coding & agent
- Voice-controlled AI agent unlocks developer's apartment on command — Baconbrix · 2026-10-02
- Pydantic hiring senior Rust engineer to build Monty, a sub-millisecond sandbox for AI agents — samuelcolvin · 2026-10-02
- Fabriq Developer launches: add 500+ integrations to your AI app with one prompt — ycombinator · 2026-10-02
- Companies are migrating from React Native to Swift as GenAI changes the calculus — mobileraj · 2026-10-02
- AI rewrites France's AROME weather model from scientific papers in four days — capetorch · 2026-10-02
- What should make you walk away from a voice-agent pilot? False confirmations — Legitimate-Pride-685 · 2026-10-02