About this paper
A Twenty Questions-style benchmark for research ideation shows that large language models make most progress early, can recognize good ideas or questions but often cannot generate them, and may benefit from externally sourced candidates in automated research systems.
Research ideation is iterative: researchers refine their ideas step by step based on feedback. Yet existing evaluations obscure this search process, making it difficult to understand how LLMs explore the space of research ideas and what limits their progress. We introduce Re-Search, which adapts the format of Twenty Questions to research ideation: given only the research problem of a published paper, a model must rediscover the paper's core idea by asking yes-or-no questions. Built from 200 ICML 2026 papers, Re-Search tracks how a model's idea evolves as it asks questions and receives binary oracle feedback, isolating ideation from execution. Across six recent LLMs, nearly all progress…
large language modelsresearch ideationRe-Searchbinary oracle feedbackhypothesis spaceexploration-exploitationautoresearch systems
- Upvotes
- 8
- Authors
- 6
- Published
- Nov 10, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Re-Search: Dissecting LLM Ideation Through a Two-Player Questioning Game was first seen on Hugging Face · Daily papers on Nov 17, 2026. Since then it has appeared in 9 checks on 2 different days. Its best position was #14 of 30, reached on Nov 17, 23:28 UTC. It dropped off the list after Nov 18, 01:28 UTC.