Dev demos real computer use: agent drives your actual Mac, voice-first
RileyRalmuto · x · 2026-11-14
Developer Riley Ralmuto previews a secret app connected to their desktop poly app offering "real" computer use: the agent operates the actual machine like a human—reading mail in the mail app rather than via connectors, while still able to tap Claude/Codex/Grok connectors. They argue current systems (Codex strong at dev tasks, Claude weak) are narrow app-like approximations; the goal is an ambient voice-driven companion for granular tasks like resizing windows, splitting tabs, iMessage, and Finder file management.
More from coding & agent
- Hands-on DeepSeek's $0.06/hr ASR API: loses to a locally fine-tuned 1.7B model — AGI Hunt · 2026-11-14
- SAG Wiki: open-source local knowledge base that skips embeddings and vector DBs, works with Claude Code — FellMentKE · 2026-11-14
- Recursive self-improving agent MolRSI lifts wet-lab hit rate 82%, beats ClaudeScience 8-0 — 机器之心 · 2026-11-14
- OpenAI $200 plan drops to $100 on Nov 20; user races to burn 4 banked Codex resets — koltregaskes · 2026-11-14
- Tonbi ships AI Garage plugin giving agents MCP access to his content catalog — Teknium · 2026-11-14
- Google's Modern Web Guidance lifts coding agents' modern web compliance from 56% to 95% — aigclink · 2026-11-14