About this paper
A training-free, lossless speculative decoding framework exploits idle compute in chunk-interleaved full-duplex speech language models to draft and verify upcoming audio chunks, substantially reducing response and tool-call delays.
Chunk-interleaved full-duplex speech language models listen and speak in fixed time chunks, and each chunk must be processed before the next one arrives. Their workload is asymmetric across chunks: listen chunks leave compute idle while awaiting audio, and speak and tool-call chunks require serial generation, which delays responses and tool calls. Using the idle compute for the next chunk requires decoding it before its audio arrives, under an assumed input. Taking silence as the assumed input and comparing the output with the output under real audio on four models, we observe two properties. First, the next audio chunk does not change the output in 95.3% of chunks. Second, 88% of changes…
full-duplex speech language modelschunk-interleavedfixed time chunksself-speculative decodinginput-time self-speculative decodingtraining-freelosslesscross-chunk hypothesis pooltool-call chunksspeak chunks
- Upvotes
- 5
- Authors
- 9
- Published
- Nov 4, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Decode Before You Hear: Speculative Listening for Chunk-Interleaved Full-Duplex Speech Language Models was first seen on Hugging Face · Daily papers on Nov 6, 2026. Since then it has appeared in 28 checks on 3 different days. Its best position was #23 of 30, reached on Nov 6, 21:28 UTC. It is #26 right now, climbing from #28 to #26 over the last 6 checks.