AI agents that watch your screen hint at an eye-tracking, voice-driven future
perilli · x · 2026-10-02
AI agents can now continuously observe your screen and act on voice commands alone — the author uses this daily and says it dramatically speeds up his workflow. The next step, he argues, is eye tracking: monitors that know where you're looking to give voice requests far richer context. In that world, productivity is bounded first by agentic inference speed and only second by human thought, making GPU speed and model architecture optimization critical — possibly why providers like OpenAI (Dots) are removing explicit model-class and reasoning-level controls from orchestrating agents.
More from AGI Musings
- NYT's Hard Fork warns A.I. agents may be "catastrophically dangerous" — nordicinst · 2026-10-02
- Erik Hoel: consciousness theories are cheap, we need money, orgs and a path — dioscuri · 2026-10-02
- Researchers warn AI-written 'salami' papers are flooding arXiv with low-value work — EhudReiter · 2026-10-02
- AI companion illusions can spiral into psychosis, researcher notes amid child bans — gerardsans · 2026-10-02
- If AI vendor commitments are voluntary, what controls can stop a bad agent? — YvesMulkers · 2026-10-02
- AI can talk about your job, but that doesn't mean it can do it, argues engineer — forevergeeks · 2026-10-02