AI Conference Review Crisis: Low Response, Hostility, and AI-Fabricated Content Accepted

Recent multiple AI researchers have raised concerns about the peer review mechanisms at top conferences such as NeurIPS, ICML, ICLR, and EMNLP/ARR. They point out that with a surge in submissions and a severe imbalance in the supply of qualified reviewers, response rates are extremely low, review attitudes tend to be hostile, and even AI-generated fabricated content has been accepted. While the existing material is insufficient to conclude that the review system has completely collapsed, numerous specific cases indicate that current review quality and accountability mechanisms are under immense pressure, directly affecting the quality and credibility of academic selection.

Confirmed

• RexDouglass and srchvrs note that AI paper submissions have surged (up to 10x), but the growth of qualified reviewers lags far behind (only 2-3x), with many new reviewers being less experienced PhD students. Under unpaid, high-pressure conditions, review quality decline is almost inevitable.
• RexDouglass mentions that NeurIPS 2026 reviewers had a response rate below 5% even after two reminders; the EMNLP ARR system has been reported to have meta-reviewers making factual errors and repeatedly requesting unnecessary ablation studies for submissions clearly labeled as datasets.
• a1zhang states that reviewers often request experiments already present in the paper and refuse to communicate or disappear during the rebuttal phase. RexDouglass also relays the pain point of authors investing significant time and API costs to run experiments only to face reviewer ghosting.
• deepakns and anpaure believe that the review atmosphere at NeurIPS, ICML, and ICLR is hostile, making researchers irritable and suspecting a vicious cycle of "retaliatory scoring."
• gabriberton notes that in ICLR 2026 reviews, they flagged 11 papers with AI-generated fake references or authors, but 2 were still accepted as oral presentations.

Unconfirmed

• Claims of "retaliatory scoring" and "full pipeline takeover by LLMs" are based on personal observations and anecdotes; existing material is insufficient to assess their prevalence.
• There is no official systematic statistics or formal response from conference organizers regarding reviewer ghosting and ineffective communication.

Why it matters

• Peer review is the core mechanism for filtering research at top AI conferences. If low response rates, erroneous reviews, and AI-fabricated content coexist, it not only buries valuable research but also allows low-quality or distorted content into the main conference.
• Many researchers therefore call for substantive reforms to the review system, including longer discussion periods, accountability and incentive mechanisms for reviewers, or reducing reliance on single-round scores.

2026-08-03 ~ 2026-08-04 · 10 related posts

Full story(4 episodes)→

• Episode 1: NeurIPS Review Season Sparks Debate Over AI Reviewers and Peer Review(2026-07-27, 2 posts)
• Episode 2: NeurIPS 2026 Rebuttal Deemed Perfunctory, Reviewer Apathy Sparks Outcry(2026-08-03, 6 posts)
• Episode 3: AI Conference Review Crisis: Low Response, Hostility, and AI-Fabricated Content Accepted(2026-08-03, 10 posts)
• Episode 4: AI Agents Are Undermining Double-Blind Peer Review(2026-08-03, 3 posts)

• [source] AI Conference Peer Review is Broken: Unresponsive Reviewers and Misguided Feedback — RexDouglass · 2026-08-03
• AI Paper Surge Exposes Peer Review Crisis, Researchers Demand Transparency — a1zhang · 2026-08-03
• [source] NeurIPS Peer Review is Broken: Exponential Submissions Meet LLM-Generated Reviews — RexDouglass · 2026-08-03
• Researchers Slam NeurIPS Review Process: Ghosting and Lack of Accountability — RexDouglass · 2026-08-03
• AI Researchers Complain About Hostile 'Revenge-Scoring' in Top Conference Peer Reviews — deepakns · 2026-08-03
• [source] AI Hallucinations Plague Peer Review: Fake Papers Still Accepted by Top Conferences — gabriberton · 2026-08-03
• AI paper submissions are up 10x, but qualified reviewers may have only tripled — srchvrs · 2026-08-04
• NeurIPS review process sparks a debate over AI-generated papers and reviews — RexDouglass · 2026-08-04
• Researcher Calls for NeurIPS Review Overhaul: Drop Discussion Period, Ban LLMs — gabriberton · 2026-08-04

1 near-duplicate retellings: anpaure