Document-generation benchmark needs a new name after DOCBENCH conflict
ell-hol1 · reddit · 2026-07-21
The author is renaming a document-generation benchmark after discovering an existing DOCBENCH project already owns the name.
- The current benchmark, DocBench Arena, is about generation: source material in, finished PowerPoint/Word documents out.
- The older DOCBENCH benchmark is about document understanding: PDF in, questions and answers out.
- The name collision is hurting discoverability on Google, so the author is asking for a better name and mentions DocGen Arena as one candidate.
- The post is mainly a naming/help request, but it also clarifies the benchmark’s task definition and how it differs from document-understanding work.
More from Research
- Argus improves indoor panoramic 3D reconstruction with covisibility and geometry transformers — ducha_aiki · 2026-07-21
- Natolambert finishes a RLHF book built from years of fine-tuning and post-training work — Jeande_d · 2026-07-21
- WAIC robots are now hitting commercially useful success rates, says a recap — chris_j_paxton · 2026-07-21
- Unitree launches a remote real-robot benchmark on its own G1 fleet — chris_j_paxton · 2026-07-21
- Frontier models still show greediness and frequency bias, researchers say — m_wulfmeier · 2026-07-21
- OpenAI internal model reportedly solves a unit-distance problem 48% of the time with enough compute — iruletheworldmo · 2026-07-21