Dan Shipper's New Experiment: Narrated Phone Screen Recordings Sent to an AI Agent for Action
danshipper · x · 2026-11-14
Dan Shipper of Every has released his weekend project as a new "frontier experiment": record your phone screen while narrating what you're looking at, and the recording is automatically sent to his personal AI assistant dot, which takes action on it.
Frontier is Every's lab log of weekly experiments testing new models, agents, and workflows in real work — over 40 entries so far, including map-driven autoresearch, a storyboard-first video editor, and Heisentool, a fake Slack for testing agents without real services.
Related event: Dan Shipper's experiment: screen recordings narrated to drive an AI agent(2 posts)→
More from coding & agent
- Multica: open-source PM platform turns Claude Code and Codex into teammates — jiayuan_jy · 2026-11-14
- Google Cloud CISO: nearly all of cybernetics and control theory applies to agentic systems — philvenables · 2026-11-14
- Building a remote MCP server that makes phone calls: long waits, mid-call questions, getting paid — jakemarsh · 2026-11-14
- Every opens its Frontier team's AI experiment log with code and writeups — danshipper · 2026-11-14
- Engineer Skips Tedious Spring Modeling by Telling Claude to 'Stretch and Align This Spring' — _Stocko_ · 2026-11-14
- Weekend project: narrated phone screen recordings piped to a personal agent — danshipper · 2026-11-14