About this paper
A framework uses coding agents and a feedback cascade to synthesize code-based policies that achieve long-horizon success and can be factored into a reusable goal compiler for zero-shot transfer to new tasks.
Coding agents can synthesize and optimize code-based policies from simulator feedback, allowing the resulting program to act with zero inference model calls. But for long horizon tasks, two challenges arise: local improvements can hurt final success and switching to a new objective requires another expensive synthesis run. We propose a framework that first develops competence by refining the policy through a feedback cascade, moving from episode returns to hierarchical goals and belief updates which can be scored densely from simulator. In the Craftax game, a partially observed and procedurally generated environment, refinements via episode level feedback stall at <1% final-level arrival,…
coding agentscode-based policiessimulator feedbackzero inference model callslong-horizon tasksfeedback cascadeepisode returnshierarchical goalsbelief updatesCraftax
- Upvotes
- 4
- Authors
- 1
- Published
- Nov 14, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Continuation-Guided LLM Evolution of Program Policies and Goal Compilers in Craftax was first seen on Hugging Face · Daily papers on Nov 17, 2026. Since then it has appeared in 8 checks on 2 different days. Its best position was #20 of 30, reached on Nov 17, 23:28 UTC. It dropped off the list after Nov 18, 07:28 UTC.