Trendoday

Correct Labels Are Not Enough: Reliable Metadata Can Silently Control Model Behavior

Fine-tuning data can include metadata that predicts the correct answer, such as a reward-model score or a quality label. We ask whether a model learns to rely on this metadata even when every training

  • Upvotes4
–Rank now
#25Peak rank
2Days on list
16Score · 7d
Nov 18, 2026First seen
Rank · 7 days

About this paper

Fine-tuning data can include metadata that predicts the correct answer, such as a reward-model score or a quality label. We ask whether a model learns to rely on this metadata even when every training label is correct. We fine-tune 7-9B open-weight models from three families on multiple-choice questions in which (Reward: 5) always marks the correct option; when this annotation is moved to a wrong option at test time, models select that option on 97-100% of CommonsenseQA items. Removing it leaves most answers correct, so evaluation without it misses the dependence. Cue-following rises sharply with training-time reliability and develops even with neutral or nonsense annotation words,…

Upvotes
4
Authors
2
Published
Nov 3, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

Correct Labels Are Not Enough: Reliable Metadata Can Silently Control Model Behavior was first seen on Hugging Face · Daily papers on Nov 18, 2026. Since then it has appeared in 4 checks on 2 different days. Its best position was #25 of 30, reached on Nov 19, 01:28 UTC. It dropped off the list after Nov 19, 01:28 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 17:2819:2821:2823:2801:28 Nov 18, 17:28 UTC · #30Nov 18, 19:28 UTC · #30Nov 18, 23:28 UTC · #30Nov 19, 01:28 UTC · #25

Last 14 days

Best rank per day (UTC).

Nov 9today

Metric history

Platform metric as reported by Hugging Face.

0235 17:2819:2821:2823:2801:28 Nov 18, 17:28 UTC · 4Nov 18, 19:28 UTC · 4Nov 18, 23:28 UTC · 4Nov 19, 01:28 UTC · 5

Questions

Is Correct Labels Are Not Enough: Reliable Metadata Can Silently Control Model Behavior trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Nov 19, 01:28 UTC, after 2 days of trending.

What is the highest rank Correct Labels Are Not Enough: Reliable Metadata Can Silently Control Model Behavior reached?

#25 on Hugging Face · Daily papers, on Nov 19, 01:28 UTC. Trendoday checks this list every 120 minutes.

How long has Correct Labels Are Not Enough: Reliable Metadata Can Silently Control Model Behavior been trending?

It was first seen on Nov 18, 2026 and has been on the list on 2 days (4 checks) since.