Trendoday

Knowing When to Teach: Learning from Teachable Prefixes in Multilingual Reasoning Distillation

On-Policy Self-Distillation (OPSD) improves reasoning by training a student on its own reasoning, using the same model conditioned on reference solutions as a teacher. Applying OPSD to multilingual re

  • Upvotes5
–Rank now
#27Peak rank
2Days on list
25Score · 7d
Nov 10, 2026First seen
Rank · 7 days

About this paper

TOPSD improves multilingual reasoning by using likelihood-based drift detection and verification to decide when teacher supervision should be applied during on-policy self-distillation.

On-Policy Self-Distillation (OPSD) improves reasoning by training a student on its own reasoning, using the same model conditioned on reference solutions as a teacher. Applying OPSD to multilingual reasoning requires the teacher to provide useful feedback across languages, even when the student makes mistakes in intermediate steps. We observe a phenomenon we call Teacher Drift: as these mistakes accumulate, the teacher may follow the student's incorrect steps instead of correcting them. Our analysis shows that this shift tends to occur earlier in lower-resource languages. To account for these differences across languages, we propose Teachable On-Policy Self-Distillation (TOPSD), which…

On-Policy Self-DistillationOPSDstudentteacherreference solutionsmultilingual reasoningTeacher Driftlower-resource languagesTeachable On-Policy Self-DistillationTOPSD
Upvotes
5
Authors
7
Published
Nov 5, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

Knowing When to Teach: Learning from Teachable Prefixes in Multilingual Reasoning Distillation was first seen on Hugging Face · Daily papers on Nov 10, 2026. Since then it has appeared in 4 checks on 2 different days. Its best position was #27 of 30, reached on Nov 10, 21:28 UTC. It dropped off the list after Nov 11, 01:28 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 19:2820:5822:2823:5801:28 Nov 10, 19:28 UTC · #28Nov 10, 21:28 UTC · #27Nov 10, 23:28 UTC · #28Nov 11, 01:28 UTC · #27

Last 14 days

Best rank per day (UTC).

Nov 3today

Metric history

Platform metric as reported by Hugging Face.

0235 19:2820:5822:2823:5801:28 Nov 10, 19:28 UTC · 5Nov 10, 21:28 UTC · 5Nov 10, 23:28 UTC · 5Nov 11, 01:28 UTC · 5

Questions

Is Knowing When to Teach: Learning from Teachable Prefixes in Multilingual Reasoning Distillation trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Nov 11, 01:28 UTC, after 2 days of trending.

What is the highest rank Knowing When to Teach: Learning from Teachable Prefixes in Multilingual Reasoning Distillation reached?

#27 on Hugging Face · Daily papers, on Nov 10, 21:28 UTC. Trendoday checks this list every 120 minutes.

How long has Knowing When to Teach: Learning from Teachable Prefixes in Multilingual Reasoning Distillation been trending?

It was first seen on Nov 10, 2026 and has been on the list on 2 days (4 checks) since.