Agent demand-research rules: 20 posts in 30 days or it's not validated — first audit caught a 35% overcount

armanidev_ · reddit · 2026-11-21

The author runs research/outreach agents for his web and video-editing business and imposed hard validation rules: an idea only reaches him if 20+ separate posts about the same problem appeared in 30 days across at least 2 platforms, each saved with link/date/poster, 5+ showing money, and the search being reproducible with a control. First audit caught errors in both directions: a claimed 50 daily Reddit posts asking for a video editor was really 37 (15 of 55 were editors advertising themselves), and keyword-matching for website-build requests undercounted 5 vs 10 once agents read posts filed as "other". He asks how others stop agents from grading their own homework.

Original post →

More from coding & agent

coding & agent channel →