LongZero enables large language models to self-improve long-context reasoning by synthesizing structured multi-hop and retrieval tasks and training with GRPO without external data.
Reinforcement learning (RL) is an effective way to strengthen the long-context reasoning of large language models (LLMs), but it needs training data that are long, diverse, challenging, and verifiable. Human annotation of such data is expensive, naturally occurring data are too scarce to sustain RL, and existing synthesis methods depend on external corpora or stronger teacher models, which become harder to obtain as the trained models get stronger. Recently, RL from zero data, in which a model learns from tasks it proposes itself, has achieved excellent performance, but existing methods target short-context tasks. Therefore, we propose LongZero, a method that lets an LLM improve its own…
reinforcement learninglong-context reasoninglarge language modelsGRPOmulti-hop reasoningmulti-round retrievalself-synthesis
- Upvotes
- 5
- Authors
- 2
- Published
- Oct 21, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.