About this paper
Critique overlap among peer reviews is rising, and reviews identified as LLM-generated are less distinct from each other, indicating decreasing diversity of critiques.
Peer review relies on several readers finding different problems. We measure critique overlap in conference and journal reviews. At ICLR, measured overlap rose from 12.0% in 2026 to 21.3% in 2027, in reviews from the same stage of the review process, with year-on-year rises at NeurIPS, ICML and the F1000 and PLOS journals. A third ICLR review of a paper added 5.46 new problems to the other two in 2027, against 6.12 in 2026. We apply MELD, a detector of LLM-generated text, to all reviews. Within a paper, two reviews that MELD flags overlap more than two unflagged reviews: by 3.0 points at ICLR in 2024-2025, by 4.5 points in 2026-2027, and by 5.4 points across five journal sources. These…
LLM-generated textMELDLLM-flagged reviewsdetector of LLM-generated text
- Upvotes
- 7
- Authors
- 1
- Published
- Nov 19, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Twice-Told Critiques: Claim-Level Homogenization of Peer Review in the LLM Era was first seen on Hugging Face · Daily papers on Nov 20, 2026. Since then it has appeared in 26 checks on 3 different days. Its best position was #21 of 30, reached on Nov 20, 19:29 UTC. It is #25 right now, holding steady at #25 over the last 6 checks.