After Automation: Your AI Agent Knows What You Want, But Who's It Working For?
danshipper · x · 2026-10-01
Trevin Chow, a product leader formerly at Big Cartel, writes in Every's Thesis about a critical question for the AI agent era: when agents make decisions for us, who are they actually working for?
His opening scenario: you ask your agent to find a new office; it contacts brokers and arranges tours—but who decided which buildings you'd see? If a property platform gives paying landlords more visibility, or an agent only searches its partners' listings, commercial relationships have already narrowed your options before you even evaluate the results.
The same conflict shapes software and service choices. We've always had conflicted advice, but after automation we'll also delegate which advice to seek and which tools to use. The author argues we'll need independent services to audit agent recommendations against alternatives outside the original network—while choosing which commercial terms to accept remains a human job.
More from AGI Musings
- Chinese AI models' troubling agent behavior sparks calls for a homegrown safety community — RishiBommasani · 2026-10-01
- Noam Brown on Dwarkesh Podcast: Agent Swarms, Alignment, and Recursive Self-Improvement — GregKamradt · 2026-10-01
- Zuck's 12-Year Search: Eight Failed Bets Since WhatsApp Before Muse Agent, Says Analyst — ZeYanjie · 2026-10-01
- 'My favorite hobby is ruined': AI users clash over AI displacing creative pastimes — AIandDesign · 2026-10-01
- François Fleuret: 'industrial' math will belong to machines, abstract math stays human — francoisfleuret · 2026-10-01
- The real challenge of always-on agents: permissions, approvals, and who owns the judgment call — lmoroney · 2026-10-01