Trendoday

BYOD: Build Your Own DLM - Efficient Autoregressive-to-Diffusion Language Model Conversion

Unlike autoregressive (AR) models, diffusion language models (DLMs) permit parallel token updates, flexible generation, and bidirectional attention, but leading systems rely on costly pretraining or f

  • Upvotes5
–Rank now
#24Peak rank
2Days on list
67Score · 7d
Nov 3, 2026First seen
Rank · 7 days

About this paper

BYOD converts autoregressive language models into diffusion models via parameter-efficient LoRA adapters, enabling parallel generation with minimal training cost while preserving base-model knowledge.

Unlike autoregressive (AR) models, diffusion language models (DLMs) permit parallel token updates, flexible generation, and bidirectional attention, but leading systems rely on costly pretraining or full-model fine-tuning. We present Build Your Own DLM (BYOD), a generalizable LoRA-only recipe for parameter-efficient AR-to-DLM conversion. Without architecture-specific tuning, BYOD induces diffusion generation in Gemma 2 9B, Llama 3.1 8B, Qwen2.5 7B, and Ministral 8B; to our knowledge, this is the first reported AR-to-DLM conversion of a Mistral model. The adapters comprise 4.1-5.8% of final parameters while every base-model parameter remains frozen; each 25,000-iteration conversion needs at…

diffusion language modelsLoRAparameter-efficient fine-tuningautoregressive modelsbidirectional attentionmasked sequencesnetwork function evaluationperplexity
Upvotes
5
Authors
2
Published
Oct 30, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

BYOD: Build Your Own DLM - Efficient Autoregressive-to-Diffusion Language Model Conversion was first seen on Hugging Face · Daily papers on Nov 3, 2026. Since then it has appeared in 10 checks on 2 different days. Its best position was #24 of 30, reached on Nov 3, 13:28 UTC. It dropped off the list after Nov 4, 03:28 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 09:2813:5818:2822:5803:28 Nov 3, 09:28 UTC · #27Nov 3, 11:28 UTC · #26Nov 3, 13:28 UTC · #24Nov 3, 15:28 UTC · #24Nov 3, 17:28 UTC · #28Nov 3, 19:28 UTC · #25Nov 3, 21:28 UTC · #25Nov 3, 23:28 UTC · #25Nov 4, 01:28 UTC · #24Nov 4, 03:28 UTC · #24

Last 14 days

Best rank per day (UTC).

Oct 26today

Metric history

Platform metric as reported by Hugging Face.

0369 09:2813:5818:2822:5803:28 Nov 3, 09:28 UTC · 5Nov 3, 11:28 UTC · 5Nov 3, 13:28 UTC · 6Nov 3, 15:28 UTC · 6Nov 3, 17:28 UTC · 6Nov 3, 19:28 UTC · 8Nov 3, 21:28 UTC · 8Nov 3, 23:28 UTC · 8Nov 4, 01:28 UTC · 8Nov 4, 03:28 UTC · 9

Questions

Is BYOD: Build Your Own DLM - Efficient Autoregressive-to-Diffusion Language Model Conversion trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Nov 4, 03:28 UTC, after 2 days of trending.

What is the highest rank BYOD: Build Your Own DLM - Efficient Autoregressive-to-Diffusion Language Model Conversion reached?

#24 on Hugging Face · Daily papers, on Nov 3, 13:28 UTC. Trendoday checks this list every 120 minutes.

How long has BYOD: Build Your Own DLM - Efficient Autoregressive-to-Diffusion Language Model Conversion been trending?

It was first seen on Nov 3, 2026 and has been on the list on 2 days (10 checks) since.