Shipping a 'simple' lead-capture agent: why privacy and consent keep breaking the architecture
ravann4 · reddit · 2026-10-03
A developer details the real engineering behind a lead-capture chat agent for a real-estate client — originally scoped as one prompt and two tools for a week, it ballooned as requirements changed and the listing feed grew to 80k entries.
Final architecture (3 tiers)
- Tier 1, code only: taps, yes/no, bare email/phone — no model
- Tier 2, a 300ms classifier: abuse, consent, bot checks, privacy questions
- Tier 3, one LLM call with 3 tools; every tool call gated by code, every recorded field checked against the buyer's actual words
Where privacy keeps breaking: the model claimed there was no privacy policy link (there was), rewrote the required consent sentence (now hardcoded), "Did you send it?" got misclassified, local test chats leaked into the client's real CRM via a shared dev database, and a corrected email still sent the old one. Every time the model touched compliance text it drifted; every rule moved into code spawned new edge cases.
Open questions: keep the fast classifier (0 of 33 failures were its fault)? Is GPT-6 Luna the right tool-calling pick (68/9/2 vs 62/13/4 pass/partial/fail, half the cost)? How to guarantee consent steps survive weekly requirement churn?
Related event: Real-World Lessons From Running a Real Estate Lead Agent for Months(2 posts)→
More from coding & agent
- Replit CEO: 'having a contract with your agent' is a paradigm many will copy — amasad · 2026-11-20
- Google launches Tool Retrieval in Gemini API preview to scale agents with hundreds of tools — OnlineInference · 2026-11-20
- Replit's agent swarm built a monitoring tool in 2 days on a $3,000 cap — the contract-first trick — amasad · 2026-11-20
- What's the Actual Difference Between AI Models and AI Agents? — HarperSCarroll · 2026-11-20
- Victor Taelin's Bend2 talk from SF Lean Meetup explains the rationale behind the language design — pbaylies · 2026-11-20
- Drex Router cuts small-game build cost to $1.26 vs $13.44 on Claude Opus alone — testingcatalog · 2026-11-20