How GPT-6 Astra's computer use works: it rides on the accessibility tree
iamrobotbear · x · 2026-09-09
A technical teardown of OpenAI's GPT-6 Astra reveals its computer-use capability relies on the accessibility tree (a11y tree), originally built to help users with vision/hearing impairments. The author read the source code and analyzed the agent loop behind Astra's headline demos like using Blender to generate 3D worlds — a byproduct of its new computer-use abilities.
Related event: Deep Dive into GPT-6 Astra Computer Use Reveals a11y Tree Core(2 posts)→
More from coding & agent
- Dev builds Capi, a kids' emotion-story app, in a weekend with GPT-6 Astra and fal Agent — noahsolomon · 2026-09-09
- Browser Demo Renders 139k Trees and 240 Buildings in 4k Characters — tomjohndesign · 2026-09-09
- ZeroClick launches Agent Storefronts, letting businesses sell to AI agents via x402 and USDC — kleffew94 · 2026-09-09
- How to build a self-healing CI pipeline with agents — AI triage, human gate — Pavan_Belagatti · 2026-09-09
- Hand An AI Agent A setup.md On A New Box And It Installs Everything For You — draginol · 2026-09-09
- Netlify demos OpenCode for comparing AI models, costs and task fit — thisiskp_ · 2026-09-09