StateAct hits a new OSWorld 2.0 SOTA by using program state instead of pixels
LiJunnan0409 · x · 2026-07-29
StateAct reaches a new OSWorld 2.0 SOTA by prioritizing program state over pixels
The post highlights StateAct, a new approach for long-horizon computer-use agents. Its core idea is to treat program state—files, backends, and DOM—as the primary interface, instead of relying mainly on screenshots.
Key claims from the thread:
- The agent barely looks at the screen, using a GUI specialist only for genuinely visual subgoals.
- That visual fallback is used in just 1.1% of steps.
- On the same Claude Opus 4.8 setup, the method improves OSWorld 2.0 performance, with the post citing gains from 20.6% to 26.9% on binary and 54.8% to 61.x% on partial.
The takeaway is that for long-horizon computer use, the winning signal may be less about better screenshots and more about structuring access to the underlying application state.
Related event: Salesforce's StateAct Framework Sets New SOTA on OSWorld 2.0(5 posts)→
More from coding & agent
- DBHub shows how it upgraded to MCP 2026-07-28 with stateless core and header routing — rokk07 · 2026-07-29
- DBHub Adopts the New MCP Spec: Stateless Core and Caching Practices — db-master · 2026-07-29
- Kimi K3 reportedly works well in Kimi Code and Claude Code via the Responses API — zainhas · 2026-07-29
- Figma and Sentry MCP servers push design data and live errors into coding agents — heypearlai · 2026-07-29
- GitHub MCP Server and Context7 emerge as core tools for coding agents — heypearlai · 2026-07-29
- Cutting half your MCP servers may make your agent smarter overnight — heypearlai · 2026-07-29