Datalab Releases omni_parse_bench: ~490K-Row Document Parsing Benchmark on HF
VikParuchuri · x · 2026-10-28
Responding to criticism that it only benchmarks against "dead" rivals like Textract, Marker creator VikParuchuri points to datalab-to/omniparsebench on Hugging Face: 2.9k test pages across suites like arXiv math papers, with a results split of 489k rows covering multiple output formats (blocks, HTML) for document-parsing evaluation.
More from Research
- Can AI search automatically discover cross-field math connections like Fermat's proof? — IgorCarron · 2026-10-28
- New bioRxiv paper reframes enzyme function prediction as conditional generation — KevinKaichuang · 2026-10-28
- New generative model predicts enzyme reaction mechanisms straight from sequence — KevinKaichuang · 2026-10-28
- GenAI is creeping into bestselling novels, study featured in Nature — TuhinChakr · 2026-10-28
- Nathan Lambert: open models' demise exaggerated, but AA index flattered them — natolambert · 2026-10-28
- Local NCM benchmarks: 4x faster for one request, 4-8x slower at 64 concurrent — Prompt Engineering · 2026-10-28