GraphRAG with Sub-30B Models Excels at Cross-Document Multi-Hop Reasoning in Marathi
kmeanskaran · x · 2026-08-18
The author benchmarked GraphRAG against VectorRAG on Marathi government scheme documents, with deliberately mixed evaluation data. Key finding: GraphRAG works exceptionally well for cross-document multi-hop reasoning, even with sub-30B models.
- Setup: 29 Marathi documents through identical text and the same encoder (nomic-embed-text-v2-moe). GraphRAG extracted SVO triples via LLM into Neo4j (Entity-[:REL]->Entity); VectorRAG chunked into ChromaDB with top-k=5.
- Eval set: 36 questions—20 cross-document multi-hop, 8 unanswerable traps, 6 multi-fact single-doc, 2 direct-fact; 28 required cross-document reasoning, each annotated with bridgeentity and bridgepath.
- Queries covered one-hop (direct facts) and two-hop (A → hub → B) paths, showing small models plus graph structure can handle complex reasoning.
Related event: Study finds GraphRAG outperforms vector RAG in multi-hop reasoning(2 posts)→
More from Research
- Retriever: A Framework for Asynchronous, Closed-Loop Robot Agents — ZeYanjie · 2026-08-24
- Converting GMMs ↔ PEFs for fast KLD approximation — FrnkNlsn · 2026-08-24
- Netflix details its production LLM judge: hundreds of thousands of recommendations scored weekly — omarsar0 · 2026-08-24
- Nature Comment: Provenance, not interpretability, grounds trust in autonomous science — gabepgomes · 2026-08-24
- New Architecture RHEA: Train 1B Model on 8GB VRAM — zemondza · 2026-08-24
- Trained two 16M-param models to do generative CAD with real physics — debreuil · 2026-08-24