Apple's MintAct unifies GUI agents across mobile, desktop, and web, hitting SOTA 48.9 on OSWorld-Verified
apple · hf · 2026-09-21
Apple introduced MintAct, a family of vision-language models (2B, 4B, 8B) that unifies UI grounding, multi-step navigation across mobile, desktop, and web, and visual tool use — matching per-domain specialists across all capabilities.
Infrastructure: Hundreds of concurrent environment instances on heterogeneous backends serve both trajectory collection and online RL; an asynchronous RL framework gives explicit control over cross-domain training distribution and stays stable under noisy feedback and off-policy drift.
Results: State-of-the-art 48.9 on OSWorld-Verified among comparable model sizes.
More from Embodied
- UBTECH sells 400 U1 Pro humanoids to Yongda Auto in ~$10M deal — CyberRobooo · 2026-11-12
- Baidu World 2026 to showcase Apollo Go robotaxi rides and Apollo World physical AI model — Baidu_Inc · 2026-11-12
- NVIDIA's open-source Alpamayo 2 Edge VLA driving model lands in Autoware — drmapavone · 2026-11-12
- A closer look at Astra's robot gripper design (and a joke at its expense) — _Stocko_ · 2026-11-12
- Robot startup passes first presale milestone with 10+ units claimed — R4nsack · 2026-11-12
- Runway launches Praxis-1, a 27B MoE world action model, with a 73ms Fast variant — ChongZzZhang · 2026-11-12