Extracting Entities and Relations from 5M Court Decisions Without an Expensive LLM Pass
SignificantZebra5883 · reddit · 2026-09-22
A developer processing 5M public Polish court decisions seeks advice on scalable entity/relation extraction: a 13-document pilot already yields 160 distinct entity-type strings (90 singletons), spanning abstract legal concepts that break both a 20k-char 'god schema' and simple NER. Their candidate pipeline uses a small entity extractor plus a fine-tuned relation classifier; prior Jina-embedding nearest-neighbor merging with LLM arbitration worked at small scale, but they fear discovering design errors 250k documents in.
More from Research
- Inference-free SPLADE: retrieval at BM25-like query cost without per-query inference — qdrant_engine · 2026-09-22
- Higher-resolution microscopy can hurt CNNs: downsampling 4x improves U-Net segmentation — bravo_abad · 2026-09-22
- Did OpenAI Solve the Wrong Navier-Stokes Problem? Experts Cry Loophole — joshgans · 2026-09-22
- Bridging LLM Decision Readouts into DuckDB: Zero-Token Probabilistic Classification via LuaJIT UDFs — Shoddy_Telephone9702 · 2026-09-22
- LLM agents fail to converge in double auctions, allocate less efficiently than humans — WillRinehart · 2026-09-22
- SVEET: streaming video editing with a diffusion model hits 15 FPS on a single H100 — SJTU · 2026-09-22