Correct Labels Are Not Enough: Reliable Metadata Can Silently Control Model Behavior
Fine-tuning data can include metadata that predicts the correct answer, such as a reward-model score or a quality label. We ask whether a model learns to rely on this metadata even when every training
- Upvotes4