About this paper
Glance integrates reranking and generation into a single backbone using lightweight adapters and pointer heads to score passages from shared context, reducing memory overhead while improving retrieval and answer quality.
Retrieval-augmented generation commonly serves separate models for reranking and answering, duplicating model residency and passage processing. We introduce Glance, which equips the generator with a lightweight decision adapter and pointer head to score candidate passages from a shared prefill. Short relevance probes branch from the cached context, producing one score per passage without separately prefilling each query-passage pair. A single resident 9B backbone supports generation, general decisions and reranking, with approximately 0.1 GiB of additional memory per decision skill. After 39 minutes of MS MARCO fine-tuning, Glance achieves nDCG@10 of 0.741 on SciFact and 0.345 on NFCorpus,…
retrieval-augmented generationrerankingpointer headdecision adaptershared prefillcross-encodernDCG@10answer F1
- Upvotes
- 12
- Authors
- 2
- Published
- Oct 29, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Glance: The Generator Is Its Own Reranker was first seen on Hugging Face · Daily papers on Oct 30, 2026. Since then it has appeared in 40 checks on 4 different days. Its best position was #19 of 30, reached on Oct 30, 17:28 UTC. It dropped off the list after Nov 2, 13:28 UTC.