LLM confidently gives wrong refund policy answer; developer shows 4-step RAG fix
_jaydeepkarale · x · 2026-11-02
@viveknaskar shares a classic failure case: ask an LLM "How many days do I have to request a refund?" and it confidently says 30 days — while your actual policy says 14. The model simply doesn't know your private documents.
He lays out a 4-step RAG pipeline to fix this, walking through each stage: the problem, the full pipeline, finding the right chunks, and building the prompt and answer. Retweeted by @jaydeepkarale with a step-by-step explainer video, a useful intro for developers grounding LLM answers in private business docs.
More from coding & agent
- Dialkit macOS: open-source live inspector for tuning iOS UI from your Mac — mikelikesdesign · 2026-11-02
- Developer ships v0.6.83 entirely via autonomous agents, zero human input — jasonkneen · 2026-11-02
- OpenCode MAU jumps 28% to 22M in October, biggest growth since March — ycombinator · 2026-11-02
- Open-source pixel-plays: browser games as isometric pixel dioramas, one JS file, zero dependencies — algo_diver · 2026-11-02
- Power user's monthly AI bill: 7.9B Codex tokens, ~$4,800 API-equivalent on a subscription — bytebot · 2026-11-02
- Dev builds a MetaHuman alternative for three.js in a weekend with Claude — majidmanzarpour · 2026-11-02