Factorization-Guided Training and Inference for Diffusion-Drafted Speculative Decoding
Speculative decoding accelerates large language model inference through parallel verification of tokens proposed by a drafter. Diffusion drafters further parallelize proposal generation, but greater p