Trendoday

CaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents

Across coding, web, and tool-use tasks, language-model agents are now routinely trained with the same recipe: supervised fine-tuning (SFT) to learn the interface, then multi-turn reinforcement learnin

  • Upvotes14
–Rank now
#13Peak rank
2Days on list
202Score · 7d
Nov 2, 2026First seen
Rank · 7 days

About this paper

CaPtain trains small open vision-language models via supervised fine-tuning and multi-turn reinforcement learning with a physical critic to perform robot manipulation through code, achieving strong results without frontier models or vision-language-action backbones.

Across coding, web, and tool-use tasks, language-model agents are now routinely trained with the same recipe: supervised fine-tuning (SFT) to learn the interface, then multi-turn reinforcement learning (RL) to master it. Code-as-policy (CaP) casts robot manipulation in the same form, as the policy writes code against robot APIs and reads back the results, so the same recipe should apply. Yet existing CaP agents sidestep training: they either prompt closed frontier models or delegate manipulation to pre-trained vision-language-action models (VLAs) and high-level skills, while small open vision-language models (VLMs) fail outright. We present CaPtain, an open post-training pipeline that…

supervised fine-tuningmulti-turn reinforcement learningcode-as-policyvision-language modelsphysical criticCaPtain-Harness
Upvotes
14
Authors
6
Published
Oct 29, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

CaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents was first seen on Hugging Face · Daily papers on Nov 2, 2026. Since then it has appeared in 13 checks on 2 different days. Its best position was #13 of 30, reached on Nov 2, 11:28 UTC. It dropped off the list after Nov 3, 07:28 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 07:2813:2819:2801:2807:28 Nov 2, 07:28 UTC · #19Nov 2, 09:28 UTC · #15Nov 2, 11:28 UTC · #13Nov 2, 13:28 UTC · #13Nov 2, 15:28 UTC · #15Nov 2, 17:28 UTC · #17Nov 2, 19:28 UTC · #16Nov 2, 21:28 UTC · #17Nov 2, 23:28 UTC · #17Nov 3, 01:28 UTC · #17Nov 3, 03:28 UTC · #15Nov 3, 05:28 UTC · #15Nov 3, 07:28 UTC · #14

Last 14 days

Best rank per day (UTC).

Oct 26today

Metric history

Platform metric as reported by Hugging Face.

061319 07:2813:2819:2801:2807:28 Nov 2, 07:28 UTC · 14Nov 2, 09:28 UTC · 15Nov 2, 11:28 UTC · 16Nov 2, 13:28 UTC · 17Nov 2, 15:28 UTC · 18Nov 2, 17:28 UTC · 18Nov 2, 19:28 UTC · 18Nov 2, 21:28 UTC · 18Nov 2, 23:28 UTC · 18Nov 3, 01:28 UTC · 18Nov 3, 03:28 UTC · 19Nov 3, 05:28 UTC · 19Nov 3, 07:28 UTC · 19

Questions

Is CaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Nov 3, 07:28 UTC, after 2 days of trending.

What is the highest rank CaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents reached?

#13 on Hugging Face · Daily papers, on Nov 2, 11:28 UTC. Trendoday checks this list every 120 minutes.

How long has CaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents been trending?

It was first seen on Nov 2, 2026 and has been on the list on 2 days (13 checks) since.