MorrowCache proxy dedupes paraphrased prompts: 2817ms miss to 423ms hit
TurnoverSea9119 · reddit · 2026-09-26
TurnoverSea9119 shipped MorrowCache (try: npx @kushalicious/jevcache@latest), a local OpenAI-compatible proxy that stops you paying twice for paraphrased prompts. An adjudicator model does real intent matching (not cosine embedding vibes) against the cache: HIT reuses the stored answer and skips the upstream call, MISS calls the model once, and a flaky judge fails open. Judges: cloud Jev (default) or local Kev/Laya/System One via ADJUDICATOR env. Recorded run: 2817ms miss → 423ms hit on a paraphrase, 6.7x faster with mostly-free latency.
More from coding & agent
- Making GA4 Agent-Friendly: Building Analytics Tools for an MCP Server — DutchSEOnerd · 2026-09-26
- Loop engineering beats prompt engineering: build agent loops that self-verify — goyalshaliniuk · 2026-09-26
- "Cognitive Feudalism": a 60-Second Visual Essay Written Frame-by-Frame in Code by Claude — CurieuxExplorer · 2026-09-26
- One Prompt, 1,850 Lines of Code: Claude Builds a Mumbai Walkthrough With No Assets — CurieuxExplorer · 2026-09-26
- Grok Bot Was Hidden in Cursor All Along: Enable the Sidebar for Seamless Handoff — CurieuxExplorer · 2026-09-26
- One prompt, 86 minutes, $25.66: Claude Opus 5.5 builds an interactive lens physics lab — CurieuxExplorer · 2026-09-26