Video dubbing aims to synthesize lip movements that match target speech while preserving the speaker identity, head pose, and background of a source video. Existing editors are predominantly trained v
VidDub is a two-step diffusion video dubbing model that uses replacement-aware cross-audio supervision to avoid conflicting source-mouth targets and achieves strong lip synchronization with high visual fidelity.
Video dubbing aims to synthesize lip movements that match target speech while preserving the speaker identity, head pose, and background of a source video. Existing editors are predominantly trained via self-reconstruction under original paired audio, even though the source mouth becomes a conflicting target when driving speech is replaced. We introduce replacement-aware cross-audio supervision: paired-audio samples use full-frame reconstruction, whereas unpaired replacement-audio samples mask out source-mouth reconstruction losses and supervise the mouth solely through audio-visual synchronization while preserving unmasked facial regions and background. Because offline dubbing provides…
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
VidDub: Replacement-Aware Distillation for Two-Step Video Dubbing was first seen on Hugging Face · Daily papers on Nov 5, 2026. Since then it has appeared in 20 checks on 2 different days. Its best position was #21 of 30, reached on Nov 6, 21:28 UTC. It dropped off the list after Nov 6, 23:28 UTC.
Position on Hugging Face · Daily papers at every check (lower is better).
Best rank per day (UTC).
Platform metric as reported by Hugging Face.
Archived daily, weekly and monthly lists that include this entry.
Not at the moment. It was last on the list on Nov 6, 23:28 UTC, after 2 days of trending.
#21 on Hugging Face · Daily papers, on Nov 6, 21:28 UTC. Trendoday checks this list every 120 minutes.
It was first seen on Nov 5, 2026 and has been on the list on 2 days (20 checks) since.