Offline Wins Earn a Shadow-Mode Test, Not the Keys to the Whole Business

mikegiannulis · x · 2026-09-18

Next steps: shadow mode for the reranker, portal routing, "already did that" detection, and contact preferences — logging both decisions, checking disagreements, and keeping a kill switch.

The closing principle: an offline win earns a production test; it doesn't earn the keys to the whole business.

Related event: Small model beats LLM on reranking and routing; real win is latency, not the 20-cent bill(8 posts)→

Original post →

More from coding & agent

coding & agent channel →