Trendoday

Regularized Score Centering

Asynchronous reinforcement learning increases training throughput, but data from stale policies and numerical mismatch between training and inference can destabilize learning. To stabilize off-policy

  • Upvotes7
–Rank now
#20Peak rank
2Days on list
49Score · 7d
Nov 18, 2026First seen
Rank · 7 days

About this paper

Asynchronous reinforcement learning increases training throughput, but data from stale policies and numerical mismatch between training and inference can destabilize learning. To stabilize off-policy learning, score centering (SC) removes the effect of reward baselines on the expected update. Our gradient diagnostics show less extreme gradients with SC than with importance sampling (IS), but SC can still fail when the learner moves far from the behavior policy that generated the data. To limit this policy mismatch, we introduce Regularized Score Centering (RSC), which adds a reverse Kullback-Leibler (KL) penalty to encourage the learner's next-token distribution to stay close to the…

Upvotes
7
Authors
5
Published
Nov 16, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

Regularized Score Centering was first seen on Hugging Face · Daily papers on Nov 18, 2026. Since then it has appeared in 4 checks on 2 different days. Its best position was #20 of 30, reached on Nov 18, 07:28 UTC. It dropped off the list after Nov 19, 01:28 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 07:2811:5816:2820:5801:28 Nov 18, 07:28 UTC · #20Nov 18, 09:28 UTC · #23Nov 18, 11:28 UTC · #24Nov 19, 01:28 UTC · #30

Last 14 days

Best rank per day (UTC).

Nov 9today

Metric history

Platform metric as reported by Hugging Face.

0369 07:2811:5816:2820:5801:28 Nov 18, 07:28 UTC · 7Nov 18, 09:28 UTC · 9Nov 18, 11:28 UTC · 9Nov 19, 01:28 UTC · 4

Questions

Is Regularized Score Centering trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Nov 19, 01:28 UTC, after 2 days of trending.

What is the highest rank Regularized Score Centering reached?

#20 on Hugging Face · Daily papers, on Nov 18, 07:28 UTC. Trendoday checks this list every 120 minutes.

How long has Regularized Score Centering been trending?

It was first seen on Nov 18, 2026 and has been on the list on 2 days (4 checks) since.