Markdown docs beat a vector DB for one agent’s knowledge base, at least at small scale
Old_Visual_6596 · reddit · 2026-07-24
The author replaced a full vector-database retrieval stack with a folder of cross-linked Markdown files and found it worked better for a few thousand pages of docs.
Why it was easier
- Markdown preserves whole concepts instead of splitting them across chunks.
- Retrieval bugs are inspectable: open the file, see the issue, fix the source.
- The knowledge base lives in git, so changes are diffable, versioned, and reversible.
- There is no separate index drifting out of sync with the source of truth.
Where it breaks down
- This is a scale-dependent solution; the author says a few thousand documents are fine, but millions would still need real vector infrastructure.
- It depends on current models being good at navigating structured Markdown with plain file tools and grep.
The post asks where other people hit the crossover point and whether anyone is using a hybrid setup where files remain the source of truth and the index is only derived.
More from coding & agent
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11
- Investment Analyst Asks How to Build a Claude-Based Diligence Agent Stack — Careless_Tie2286 · 2026-09-11
- How Do You Catch Behavioral Regressions in LLM Agents Between Releases? — Beautiful_Belt_601 · 2026-09-11
- Treating agents like 50 First Dates: a 3-layer context system so every conversation doesn't start from zero — evielync · 2026-09-11
- Running the Firefox MCP on Android via Termux, ngrok, and mcp-proxy — Nervous-Strain7544 · 2026-09-11
- Run Firefox MCP on Android: Termux + ngrok tunnel tutorial — Nervous-Strain7544 · 2026-09-11