Continual-ARC, a lifelong stream of ARC-AGI tasks, compares memory- and weight-based continual learning under frozen-weight agent harnesses, revealing that harness persistence rarely improves memorization and most harness methods underperform simple caching, while weight-based learning shows…
Agent harnesses have emerged as a promising mechanism for continual learning, alongside test-time parametric learning. However, the current benchmarks have several limitations: they generally focus on a single applied domain, serve each instance only once, and assume a single family of learner, so memory-based and weight-based systems are rarely compared on the same scale. We propose Continual-ARC, a lifelong stream built from the three ARC-AGI editions, whose tasks need no domain knowledge. The same tasks return after dormant gaps with fresh instances, while new tasks keep arriving. On each instance, the learner may pay for demonstrations, submit answers, or act inside the harness, with…
continual learningtest-time parametric learningagent harnessesmemory-based systemsweight-based systemsfrozen weightsprompting floorsprogram-induction methodweight-based learningpersistence
- Upvotes
- 9
- Authors
- 3
- Published
- Nov 11, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.