How GPT-6 Astra's computer use works: it rides on the accessibility tree
iamrobotbear · x · 2026-09-09
A technical teardown of OpenAI's GPT-6 Astra reveals its computer-use capability relies on the accessibility tree (a11y tree), originally built to help users with vision/hearing impairments. The author read the source code and analyzed the agent loop behind Astra's headline demos like using Blender to generate 3D worlds — a byproduct of its new computer-use abilities.
Related event: Developer Reverse-Engineers GPT-6 Astra Computer Use(3 posts)→
More from coding & agent
- 250 Builders Hack With Codex at Berlin Community Hackathon Ahead of OpenAI DevDay — paw_lean · 2026-10-26
- Ben Bajarin: Frontier AI is becoming the enterprise cyber-defense stack — BenBajarin · 2026-10-26
- Building AI bots on raw APIs? Devs say models are 'dumb without the harness' — madeofAjala · 2026-10-26
- HarnessMM cuts agent tokens per task by up to 88% while raising success rates — omarsar0 · 2026-10-26
- Microsoft demos intent-classifying agents built with Copilot App and Foundry, deployable across Teams and Outlook — marlene_zw · 2026-10-26
- Looking for a wearable mic with best battery life that feeds recordings to personal agents via MCP — altryne · 2026-10-26