OpenReviewer: Open-source 8B LLM fine-tuned on 79K expert reviews generates critical peer reviews for AI papers
alejandroll10 · x · 2026-08-09
OpenReviewer is an open-source system for generating high-quality peer reviews of machine learning and AI conference papers. At its core is Llama-OpenReviewer-8B, an 8B parameter language model fine-tuned on 79,000 expert reviews from top conferences like ICLR and NeurIPS.
Key features include:
- Specialized model fine-tuned on 79K expert reviews
- Generates realistic, critical reviews matching human standards
- Structured output following conference-specific templates
- PDF processing extracting full text including equations and tables
- Open source for research and development
Evaluation on 400 test papers shows significant improvement over baselines.
More from Research
- MLCommons launches MLPerf Endpoints, a benchmark that measures inference endpoints the way buyers actually purchase them — TheKanter · 2026-10-16
- DIY LEGO bench tests AI brick-building, GPT-6 Astra beats Opus — TheLegoless · 2026-10-16
- tszzl's theory: Tornado → Apache license → apaches → Southwest → Colorado — tszzl · 2026-10-16
- DIRECT: retrieval-based next-question suggestions for conversational agents — burkov · 2026-10-16
- A Qwen3 neuron tracks both Colorado and Tornado HTTP code; tszzl offers a theory — tszzl · 2026-10-16
- AI-Driven Timing-Aware Power Optimization Uses Learned Ranking With Baseline-Preserving Repair — Amit Sharma · 2026-10-16