Trendoday

LiveFoley: Dynamic Real-Time Video-to-Audio Generation for Immersive Interactive Worlds

Streaming video-to-audio (V2A) generation is essential for immersive interactive applications. However, real-time constraints leave existing streaming V2A methods far behind offline models: (1) visual

  • Upvotes5
#29Rank now 1
#29Peak rank
3Days on list
21Score · 7d
Nov 6, 2026First seen
Rank · 7 days

About this paper

LiveFoley improves streaming video-to-audio generation by using a trailing sliding window for visual alignment and expanded temporal denoising windows for audio quality with minimal latency.

Streaming video-to-audio (V2A) generation is essential for immersive interactive applications. However, real-time constraints leave existing streaming V2A methods far behind offline models: (1) visual frontends shrink their receptive fields to cut look-ahead latency, severely degrading audio-visual alignment; (2) causal autoregressive diffusion backends denoise each audio patch in isolation, impairing audio quality. To this end, we present LiveFoley, a streaming causal autoregressive diffusion architecture that addresses both bottlenecks with imperceptible latency. For the visual frontend, we introduce a Trailing Sliding Window that converts non-causal segment-level encoders into streaming…

streaming video-to-audiocausal autoregressive diffusionTrailing Sliding WindowUnified Varhop Frameworklocal diffusion transformerLocDiTHistory LocDiTFuture-Warmup LocDiT
Upvotes
5
Authors
9
Published
Nov 4, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

LiveFoley: Dynamic Real-Time Video-to-Audio Generation for Immersive Interactive Worlds was first seen on Hugging Face · Daily papers on Nov 6, 2026. Since then it has appeared in 13 checks on 3 different days. Its best position was #29 of 30, reached on Nov 6, 21:28 UTC. It is #29 right now, climbing from #30 to #29 over the last 6 checks.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 21:2808:2819:2806:2817:28 Nov 6, 21:28 UTC · #29Nov 6, 23:28 UTC · #29Nov 7, 01:28 UTC · #29Nov 7, 03:28 UTC · #29Nov 7, 05:28 UTC · #29Nov 7, 07:28 UTC · #29Nov 7, 09:28 UTC · #29Nov 7, 11:28 UTC · #30Nov 7, 13:28 UTC · #30Nov 7, 15:28 UTC · #30Nov 8, 13:28 UTC · #30Nov 8, 15:28 UTC · #30Nov 8, 17:28 UTC · #29

Last 14 days

Best rank per day (UTC).

Oct 26today

Metric history

▲ as reported by Hugging Face.

0358 21:2808:2819:2806:2817:28 Nov 6, 21:28 UTC · 5Nov 6, 23:28 UTC · 5Nov 7, 01:28 UTC · 5Nov 7, 03:28 UTC · 5Nov 7, 05:28 UTC · 5Nov 7, 07:28 UTC · 5Nov 7, 09:28 UTC · 5Nov 7, 11:28 UTC · 5Nov 7, 13:28 UTC · 5Nov 7, 15:28 UTC · 5Nov 8, 13:28 UTC · 7Nov 8, 15:28 UTC · 7Nov 8, 17:28 UTC · 8

Questions

Is LiveFoley: Dynamic Real-Time Video-to-Audio Generation for Immersive Interactive Worlds trending on HF Daily Papers right now?

Yes. As of Nov 8, 17:28 UTC it is #29, climbing from #30 to #29 over the last 6 checks.

What is the highest rank LiveFoley: Dynamic Real-Time Video-to-Audio Generation for Immersive Interactive Worlds reached?

#29 on Hugging Face · Daily papers, on Nov 6, 21:28 UTC. Trendoday checks this list every 120 minutes.

How long has LiveFoley: Dynamic Real-Time Video-to-Audio Generation for Immersive Interactive Worlds been trending?

It was first seen on Nov 6, 2026 and has been on the list on 3 days (13 checks) since.