Open-source Paper Review Harness simulates 30 AI reviewers for top ML conferences
DebateAccurate6097 · reddit · 2026-10-13
A Reddit post highlights Paper Review Harness, an open-source project that uses 30 different AI reviewer personas to simulate feedback for CVPR, ICLR, ICML, and NeurIPS papers.
Beyond a simple "review my paper" prompt, it provides independent multi-perspective reviews, section-level scores and criticism, weakness identification across novelty/methodology/experiments/clarity, prioritized improvement feedback, and a revision workflow tracking whether prior concerns were addressed. It supports different review panels per conference and contribution type, works with AI agent environments, and is open source. The author notes simulated reviews can't replace real peer review and scores aren't acceptance predictions.
More from coding & agent
- Laude Institute launches FrontierCS 2: agents must beat deleted paper contributions blind — lateinteraction · 2026-10-23
- Index Network open-sources Social Discovery Protocol: agents negotiate fit on your behalf — carsonfarmer · 2026-10-23
- Installed a formal-verification skill: it silently installed Java, MacBook runs 10 degrees hotter — zealcaiden · 2026-10-23
- OpenAI's Decisions API hits GA: near real-time routing up to 10x faster than GPT-6 Luna — OpenAIDevs · 2026-10-23
- Ruff author warns: upgrade Node/Bun now — --use-system-ca still accepts the eMudhra cert — charliermarsh · 2026-10-23
- Proof of Agent: paste one prompt and your AI mines, grades, and self-governs — adamamcbride · 2026-10-23