How much of computer-use AI gains come from accessibility trees vs screenshots?
peterjliu · x · 2026-09-17
Peter Liu raises a sharp attribution question: computer-use agents have clearly improved, but how much of that gain comes from switching to the accessibility tree (what blind users rely on to navigate websites) instead of the old paradigm of mostly screenshotting the UI? He suggests the contribution of this paradigm shift deserves to be measured separately.
More from coding & agent
- Let Codex audit your skills and agents.md to fit GPT-6 Astra — nickbaumann_ · 2026-09-17
- Stealth model Union Alpha scores 74% on DeepSWE, beating GPT-5.6 Sol at lower cost — ZeroStateReflex · 2026-09-17
- Agentic AI systems are the next network users: 40% of enterprise apps to include agents by 2026 — seankinneyRCR · 2026-09-17
- 2012 iPad mini runs 90k-line Zig game at 60fps with ~100 lines of patches — banteg · 2026-09-17
- xAI launches Grok Build coding agent powered by Grok 4.6 with cross-session memory — ns123abc · 2026-09-17
- Yandex Research: KV-cache as a runtime for concurrent LLM interaction without retraining — RichmanRonald · 2026-09-17