About this paper
Large language models used for peer review draw about half or more of their identified weaknesses from paper appendices, whereas human reviewers draw only 8.4% and focus on presentation and core ideas.
Large language models (LLMs) are increasingly used by reviewers to highlight weaknesses during the reviewing process, and their outputs often shape the reviews that humans submit. Prior work studies how LLM reviews align with human ones, yet we know little about which parts of a paper these models actually criticize. In this work, we investigate 2,000 papers from ACL, EMNLP, COLM, and ICLR, and show that the latest GPT and Claude models draw about 50% or more of their review weaknesses from the appendix. This behavior holds across the API, coding-agent, and web access methods for using LLMs to review a paper. In contrast, we find that humans draw only 8.4% of their weaknesses from the…
large language models (LLMs)GPTClaude models
- Upvotes
- 10
- Authors
- 3
- Published
- Nov 13, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
AI Reviews Are Biased Towards the Appendix was first seen on Hugging Face · Daily papers on Nov 16, 2026. Since then it has appeared in 6 checks on 2 different days. Its best position was #24 of 30, reached on Nov 16, 09:28 UTC. It dropped off the list after Nov 17, 07:28 UTC.