Microsoft releases SynthDocQA: 9,798 QA pairs over 100 synthetic PDFs to stress-test RAG
kalyan_kpl · x · 2026-10-28
Microsoft released SynthDocQA on Hugging Face: a synthetic document QA benchmark with 9,798 questions grounded in 100 synthetic PDFs spanning business domains, built to evaluate RAG pipelines, PDF parsers, and document understanding models. Licensed under CDLA-permissive-2.0; note the online dataset viewer currently fails with a JSON parsing error.
More from Research
- François Fleuret Proposes Tagging Every Token 'Heard/Thought/Said' to Solve Alignment — francoisfleuret · 2026-10-28
- AI verifies the 15,000-page finite simple groups classification in 24 days with 50M lines of Lean — FuSheng_0306 · 2026-10-28
- VibeVideoBench: multimodal agents coding videos often fail on time management — Muxi Diao · 2026-10-28
- Nearly 600 runs show full BPTT beats truncated backprop in looped transformers — Xuyuan Xiong · 2026-10-28
- Memory heuristics hurt LLM group decisions: full transcripts cut accuracy too — Anouar Imel · 2026-10-28
- Google's AI Mode feeds uncited Knowledge Graph biographies into answers, analysis shows — dejanseo · 2026-10-28