OmniOKF: Turn Messy Docs into Markdown Knowledge Graphs
[deleted] · reddit · 2026-07-10
To solve the high costs of processing long texts and the context loss in traditional chunking within RAG pipelines, a developer open-sourced the CLI tool OmniOKF. It converts messy files like PDFs and Word docs into structured, cross-linked Markdown graphs without relying on a graph database.
Core Features:
- Semantic Chunking: Splits content by heading boundaries and refines them into 200-500 token atomic concept files using Gemini Flash, saving 75-95% of query costs.
- Auto Cross-linking: Automatically scans and links related topics using relative links, making it easy for Agent logic to traverse.
- Visualization & Caching: Outputs a master index file containing Mermaid flowcharts to map document relationships; implements incremental caching via MD5 hashing to save API overhead.
- Offline Mode: Features a built-in local heuristic classifier for handling sensitive data.
The project is open-sourced on GitHub under the MIT license.
More from coding & agent
- Coding agents are heading toward an AI-writes, AI-reviews, human-approves workflow — aftahi_ai · 2026-07-22
- oMLX 0.5.2 adds Mac menu-bar stats, low-bit decode kernels, and faster downloads — awnihannun · 2026-07-22
- GitHub review bot hits its PR limit and forces a 39-minute cooldown — DanielLockyer · 2026-07-22
- Max reasoning effort appears to be mobile-only in Codex Remote, not desktop — GabGarrett · 2026-07-22
- A Reddit demo argues online stores should expose carts and pricing through MCP — gelembjuk · 2026-07-22
- Open-source AI SDK provider routes Vercel apps through a local Codex subscription — lgrammel · 2026-07-22