CMU L3 Lab CUA Week: GPT-6 Astra Passes Only 9% of Real-Time Minigames
dan_fried · x · 2026-11-07
CMU's L3 Lab wrapped up its first CUA Week with a batch of real-time agent research releases:
- Gym-Anything-RT: auto-generates 100 visual minigames requiring real-time interaction; GPT-6 Astra (xHigh) achieves only a 9.0% pass rate, revealing large capability gaps in real-time settings.
- SwarmChat: open-source Slack-style communication for AI agent swarms (CMU + Fleet AI).
- Gym-Anything for Robotics: scaling physical simulations with digital agents.
- Visual Token Routing: learning to keep the visual tokens that matter.
- Computer-Use Agents Are Embodied Generalists: a position paper showing a single computer-use agent, wired to simple GUIs, ranked 1st, 2nd, 3rd and 6th across four embodied-AI competitions at ECCV.
Key argument: agents excel when they can deliberate, but environments that evolve while the model reasons remain a major weakness.
More from coding & agent
- Pair programming with Codex listening in: design debates yield simpler agent code — angadsg · 2026-11-07
- X launches new Livestreaming API routes, old ones EOL Jan 1, 2027 — Kyrannio · 2026-11-07
- Agents are like Memento: your system prompt is their tattoo, most context never reaches them — brandon_galang · 2026-11-07
- Hacker gets Hermes Agent running on a Nintendo 3DS with voice input via custom homebrew — alexcovo_eth · 2026-11-07
- Developer's bar for AI code: if you can't explain it in review, the PR isn't done — therealdanvega · 2026-11-07
- Claude Code cloud sessions now auto-detect dependencies and securely store API keys — ClaudeDevs · 2026-11-07