Agent Automation in Action: From Screenshot to Execution
sarthi_education · reddit · 2026-07-12
This in-depth post shares two practical case studies by the author on harness engineering (adding a layer of usability orchestration around models):
- AI Video Production Pipeline: An agent first finds multiple matching models and assets based on character descriptions, then filters the most suitable images, expressions, and poses to generate character, scene, and prop images, finally plugging them automatically into storyboard drafts. The author notes it took about 4 hours to build and run, completed generation within 24 hours, and reused the workflow via skill files at a low actual cost.
- Hotel Phone/Website Customer Service Agent: Built an agent for a hotel capable of answering phones and operating on their website. Using vision and MCP(Model Context Protocol) to execute near-human actions, it achieved operations like booking, canceling, and modifying orders, taking roughly 48 hours to set up.
The author also reminds us that many web crawling/scraping services can be replaced "for free" by models and toolchains: using endpoints like NVIDIA NIM for usability speed tests, combined with local one-off quality assessments and real-time speed selection, allows for dynamically picking the optimal solution across multiple models.
Related event: Desktop Automation Achieved via VLM and MCP(2 posts)→
More from coding & agent
- HeyGen adds a media-sourcing skill for coding agents with 75k images and 10k tracks — HeyGen · 2026-07-22
- Agent search bottlenecks are now about variance, not raw latency — rohanpaul_ai · 2026-07-22
- LangSmith adds tracing for Pipecat, LiveKit, OpenAI Realtime, and Gemini Live — LangChain · 2026-07-22
- An MCP server signs every AI agent tool call into a verifiable Merkle chain — Funky_Chicken_22 · 2026-07-22
- Annotated transcript of a Claude Code team interview is now available — trq212 · 2026-07-22
- Claude Code skill uses 10 Markdown rules to make outputs ADHD-friendly — alex_verem · 2026-07-22