airbench: Testing Local Models on Visual Desktop Challenges via Keyboard and Mouse Agents
dh7net · reddit · 2026-11-13
The author built airbench, a set of visual + mouse/keyboard challenges (grid captcha, icon drag-and-drop) where local model agents must simulate desktop input to solve them, with real-speed recorded traces.
- Runs and replays are public on the airbench.ai gallery
- The first video shows most models handle these desktop-operation challenges well
- More challenge results to be shared later
More from coding & agent
- Student's AI agent defended his school's network from a cyberattack after he left for college — heyneighbor · 2026-11-13
- SGLang Summit agenda: LinkedIn serves ads model at 10K+ QPS under 80ms — DavidBennett__ · 2026-11-13
- Dev builds an OP-1-inspired skill for agentic coding, posted on GitHub Next — narphorium · 2026-11-13
- vork: open-source headless 3D/VFX engine for AI agents, renders black hole bending light in 18 min — ravisparikh · 2026-11-13
- Agent swarm spends $3M/month in tokens to build game Spawn, treats an hour without shipping as SEV-0 — dl_weekly · 2026-11-13
- GitHub Copilot CLI v1.0.110 adds masked sudo password prompts for agents and credit-aware /compact — copilot-cli-release-app[bot] · 2026-11-13