About this paper
An online reinforcement learning framework trains UI navigation agents on live mobile apps using a planning agent, UI grounding model, and a novel neighbor-conditioned value estimation method to improve robustness and reduce inference costs.
While frontier vision-language models demonstrate strong capabilities in user interface (UI) navigation, their high inference costs prohibit everyday use. Conversely, smaller models trained via supervised fine-tuning (SFT) or offline reinforcement learning often memorize static trajectories, leading to brittle execution and an inability to recover from errors. To address these limitations, we propose a novel online reinforcement learning framework that trains UI navigation agents directly on live iOS applications. Our framework decouples the agent into two specialized components: a Planning agent and a UI Grounding model. We rely on an LLM-as-a-Judge to provide comprehensive reward…
online reinforcement learningUI navigationPlanning agentUI Grounding modelLLM-as-a-JudgeProximal Policy Optimizationstep-level advantage estimationGiGPPOneighbor-conditioned value estimationconcurrent virtual iOS devices
- Upvotes
- 6
- Authors
- 5
- Published
- Oct 29, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps was first seen on Hugging Face · Daily papers on Oct 30, 2026. Since then it has appeared in 32 checks on 4 different days. Its best position was #24 of 30, reached on Nov 2, 09:28 UTC. It dropped off the list after Nov 2, 13:28 UTC.