Trendoday

Rethinking in Spikes: Mitigating Hallucinations in MDLMs with Step-Aware Decoding

Recent advancements in multimodal diffusion language models (MDLMs) have exhibited strong global modeling capabilities through iterative refinement. We observe that mask uncertainty follows an overall

  • Upvotes10
–Rank now
#5Peak rank
2Days on list
276Score · 7d
Nov 16, 2026First seen
Rank · 7 days

About this paper

StepRefine, a plug-and-play decoding strategy, mitigates hallucinations in multimodal diffusion language models by switching between discrete denoising and latent refinement based on entropy spikes and distributional stability.

Recent advancements in multimodal diffusion language models (MDLMs) have exhibited strong global modeling capabilities through iterative refinement. We observe that mask uncertainty follows an overall downward trend during iterative denoising, while a few denoising steps exhibit localized entropy spikes closely associated with hallucinations. We argue that anomalous steps can be identified by measuring the entropy deviation of each denoising step from its neighboring temporal window. We hypothesize that discrete token commitment discards the distributional information at masked positions, limiting the continued interaction between candidate semantics and the context during entropy spikes.…

multimodal diffusion language models (MDLMs)iterative refinementmask uncertaintyiterative denoisingentropy spikeshallucinationsentropy deviationtemporal windowdiscrete token commitmentdistributional information
Upvotes
10
Authors
12
Published
Oct 14, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

Rethinking in Spikes: Mitigating Hallucinations in MDLMs with Step-Aware Decoding was first seen on Hugging Face · Daily papers on Nov 16, 2026. Since then it has appeared in 13 checks on 2 different days. Its best position was #5 of 30, reached on Nov 17, 07:28 UTC. It dropped off the list after Nov 17, 07:28 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 07:2813:2819:2801:2807:28 Nov 16, 07:28 UTC · #22Nov 16, 09:28 UTC · #21Nov 16, 11:28 UTC · #19Nov 16, 13:28 UTC · #11Nov 16, 15:28 UTC · #6Nov 16, 17:28 UTC · #6Nov 16, 19:28 UTC · #7Nov 16, 21:28 UTC · #7Nov 16, 23:28 UTC · #7Nov 17, 01:28 UTC · #6Nov 17, 03:28 UTC · #6Nov 17, 05:28 UTC · #6Nov 17, 07:28 UTC · #5

Last 14 days

Best rank per day (UTC).

Nov 9today

Metric history

Platform metric as reported by Hugging Face.

0122436 07:2813:2819:2801:2807:28 Nov 16, 07:28 UTC · 10Nov 16, 09:28 UTC · 11Nov 16, 11:28 UTC · 13Nov 16, 13:28 UTC · 20Nov 16, 15:28 UTC · 35Nov 16, 17:28 UTC · 35Nov 16, 19:28 UTC · 35Nov 16, 21:28 UTC · 35Nov 16, 23:28 UTC · 35Nov 17, 01:28 UTC · 35Nov 17, 03:28 UTC · 35Nov 17, 05:28 UTC · 36Nov 17, 07:28 UTC · 36

Questions

Is Rethinking in Spikes: Mitigating Hallucinations in MDLMs with Step-Aware Decoding trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Nov 17, 07:28 UTC, after 2 days of trending.

What is the highest rank Rethinking in Spikes: Mitigating Hallucinations in MDLMs with Step-Aware Decoding reached?

#5 on Hugging Face · Daily papers, on Nov 17, 07:28 UTC. Trendoday checks this list every 120 minutes.

How long has Rethinking in Spikes: Mitigating Hallucinations in MDLMs with Step-Aware Decoding been trending?

It was first seen on Nov 16, 2026 and has been on the list on 2 days (13 checks) since.