Give Your LLM a Wiki: demo cuts input tokens by ~50%
kedar5 · reddit · 2026-09-22
Inspired by Andrej Karpathy's LLM Wiki idea, the author built and benchmarked a workflow where the LLM writes its own documentation and feeds it back to itself.
- Problem: every session re-reads the same files from scratch, and input tokens dominate coding-session costs
- Method: create one small markdown Page Wiki per app area, written once by the LLM; future sessions read the summary instead of searching the repo
- Reliability: each page is anchored to source via git blob hashes — if code changes, the hash breaks and the page marks itself STALE, failing loudly instead of quietly lying
- Result: the demo cut input tokens by 50%, and engineers get a living codebase map for free
- Full pipeline and runnable demo: https://www.arungudelli.com/ai/llm-wiki-for-code-base/
More from coding & agent
- 53 harness bugs: an engineering team's field notes on building eval harnesses — DrDatta_AIIMS · 2026-09-22
- atuin 18.23 ships infinite searchable scrollback — shell history now keeps command output — aronchick · 2026-09-22
- Open-source coding-agent skills for Google ADK on Google Cloud, distilled from real engineering lessons — Difficult_Design6676 · 2026-09-22
- After trimming his Claude Code harness, a Max 20x user now has 9 spare hours of quota a week — carlito_17 · 2026-09-22
- OpenAI shows how a surgeon uses Codex to build tools and review PubMed literature — OpenAIDevs · 2026-09-22
- Similarity Isn't Relevance: Four Layers Every Personal Agent Memory System Must Separate — sujingshen · 2026-09-22