Sentry CEO shares agent-built scraper pattern: generate selectors once, validate, skip LLM at runtime
zeeg · x · 2026-09-04
Sentry CEO David Cramer outlines a scraper architecture that minimizes agent usage: an agent generates a set of selector/typed capabilities at config time; a validator proves the generation works (inputs match outputs); the scraper then runs without the agent, which only occasionally revalidates — e.g. checking the site's content hasn't changed and selectors aren't false-matching. He admits the revalidation step is the weakest part, but says the core loop was easy to build and effective.
More from coding & agent
- What Makes You Trust a Small Tool With Your Files? Reddit Debates — Thefounderman1 · 2026-09-05
- OpenAI ships official model guidance and prompting best-practices docs with Markdown output — soumitrashukla9 · 2026-09-05
- Netlify Agent Runners now scope ambitious prompts to ship partial projects within budget — thisiskp_ · 2026-09-05
- AI Tool Aisle Found 6 Curl Vulnerabilities That Mythos and Codex Missed — CackleRooster · 2026-09-05
- 35B Open-Weight Model Tops Code Search at 100x Lower Cost Than Frontier Models — ypatil125 · 2026-09-05
- 'Evals Are the New PRD' — Swap 'What Problem?' for 'Show Me an Example' — neal_lathia · 2026-09-05