Trendoday

Actor, Judge, or Teacher? Understanding Decision Models in Long-Horizon Agents

Decision models answer a question with a typed output, such as a choice among options with a probability for each, so one model can choose an agent's actions, evaluate actions already taken, or score

  • Upvotes12
#7Rank now 1
#7Peak rank
4Days on list
474Score · 7d
Nov 13, 2026First seen
Rank · 7 days

About this paper

A decision model that acts poorly can still teach reinforcement learning policies effectively by judging complete action trajectories, improving success on ALFWorld and WebShop.

Decision models answer a question with a typed output, such as a choice among options with a probability for each, so one model can choose an agent's actions, evaluate actions already taken, or score every action to teach a policy with reinforcement learning. Prior work has studied them mainly as actors, judging their usefulness by how well they act. We ask whether a decision model that acts poorly can still teach well. We compare three decision models and three general LLMs as actors and judges on ALFWorld, and use JEV as a teacher on ALFWorld and WebShop. As actors, all six models are pulled away from a subgoal that must come first by an easier one. As judges that see the whole…

decision modelstyped outputreinforcement learningpolicyactorsjudgestrajectoriessubgoalgeneral LLMsALFWorld
Upvotes
12
Authors
10
Published
Nov 12, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

Actor, Judge, or Teacher? Understanding Decision Models in Long-Horizon Agents was first seen on Hugging Face · Daily papers on Nov 13, 2026. Since then it has appeared in 36 checks on 4 different days. Its best position was #7 of 30, reached on Nov 16, 05:28 UTC. It is #7 right now, climbing from #9 to #7 over the last 6 checks.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 Nov 13Nov 14Nov 14Nov 15Nov 16 Nov 13, 07:28 UTC · #16Nov 13, 09:28 UTC · #12Nov 13, 11:28 UTC · #11Nov 13, 13:28 UTC · #10Nov 13, 15:28 UTC · #10Nov 13, 17:28 UTC · #9Nov 13, 19:28 UTC · #9Nov 13, 21:28 UTC · #8Nov 13, 23:28 UTC · #9Nov 14, 01:28 UTC · #9Nov 14, 03:28 UTC · #9Nov 14, 05:28 UTC · #9Nov 14, 07:28 UTC · #9Nov 14, 09:28 UTC · #9Nov 14, 11:28 UTC · #9Nov 14, 13:28 UTC · #9Nov 14, 15:28 UTC · #9Nov 14, 17:28 UTC · #9Nov 14, 19:28 UTC · #9Nov 14, 21:28 UTC · #9Nov 14, 23:28 UTC · #9Nov 15, 01:28 UTC · #9Nov 15, 03:28 UTC · #9Nov 15, 05:28 UTC · #9Nov 15, 07:28 UTC · #9Nov 15, 09:28 UTC · #9Nov 15, 11:28 UTC · #9Nov 15, 13:28 UTC · #9Nov 15, 15:28 UTC · #9Nov 15, 17:28 UTC · #9Nov 15, 19:28 UTC · #9Nov 15, 21:28 UTC · #9Nov 15, 23:28 UTC · #9Nov 16, 01:28 UTC · #9Nov 16, 03:28 UTC · #8Nov 16, 05:28 UTC · #7

Last 14 days

Best rank per day (UTC).

Nov 3today

Metric history

▲ as reported by Hugging Face.

0122335 Nov 13Nov 14Nov 14Nov 15Nov 16 Nov 13, 07:28 UTC · 12Nov 13, 09:28 UTC · 21Nov 13, 11:28 UTC · 23Nov 13, 13:28 UTC · 26Nov 13, 15:28 UTC · 28Nov 13, 17:28 UTC · 29Nov 13, 19:28 UTC · 29Nov 13, 21:28 UTC · 29Nov 13, 23:28 UTC · 29Nov 14, 01:28 UTC · 29Nov 14, 03:28 UTC · 29Nov 14, 05:28 UTC · 29Nov 14, 07:28 UTC · 30Nov 14, 09:28 UTC · 30Nov 14, 11:28 UTC · 30Nov 14, 13:28 UTC · 31Nov 14, 15:28 UTC · 32Nov 14, 17:28 UTC · 32Nov 14, 19:28 UTC · 32Nov 14, 21:28 UTC · 32Nov 14, 23:28 UTC · 33Nov 15, 01:28 UTC · 33Nov 15, 03:28 UTC · 33Nov 15, 05:28 UTC · 34Nov 15, 07:28 UTC · 34Nov 15, 09:28 UTC · 34Nov 15, 11:28 UTC · 34Nov 15, 13:28 UTC · 34Nov 15, 15:28 UTC · 34Nov 15, 17:28 UTC · 34Nov 15, 19:28 UTC · 34Nov 15, 21:28 UTC · 34Nov 15, 23:28 UTC · 34Nov 16, 01:28 UTC · 34Nov 16, 03:28 UTC · 35Nov 16, 05:28 UTC · 35

Questions

Is Actor, Judge, or Teacher? Understanding Decision Models in Long-Horizon Agents trending on HF Daily Papers right now?

Yes. As of Nov 16, 05:28 UTC it is #7, climbing from #9 to #7 over the last 6 checks.

What is the highest rank Actor, Judge, or Teacher? Understanding Decision Models in Long-Horizon Agents reached?

#7 on Hugging Face · Daily papers, on Nov 16, 05:28 UTC. Trendoday checks this list every 120 minutes.

How long has Actor, Judge, or Teacher? Understanding Decision Models in Long-Horizon Agents been trending?

It was first seen on Nov 13, 2026 and has been on the list on 4 days (36 checks) since.