About this paper
Falcon is a lightweight causal audio-visual target speaker extraction method that achieves high quality with drastically reduced parameters and latency, supported by the realistic RealSSA benchmark.
Streaming audio-visual target speaker extraction (AVTSE) is essential for latency-sensitive applications. However, current causal systems face two coupled gaps. First, standard benchmarks fix the number of speakers at two and ignore the near-/far-field interference, reverberation, and sudden noise of real scenes. Second, high-performance causal architectures are too heavy for edge deployment. Lightweight alternatives try to reclaim capacity by repeatedly invoking a small separator, which offsets the savings. To address the first gap, we release RealSSA, a realistic AVTSE benchmark consisting of RealSSA-Sim and RealSSA-Real. RealSSA-Sim provides controllable simulated scenes with 1--5…
audio-visual target speaker extractioncausal AVTSERealSSAFalconmulti-scale time-frequency separationencoder-space speaker contrastive lossnear-field leakage suppression
- Upvotes
- 142
- Authors
- 5
- Published
- Oct 23, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Efficient Streaming Audio-Visual Target Speaker Extraction for Real-World Acoustic Scenes was first seen on Hugging Face · Daily papers on Oct 29, 2026. Since then it has appeared in 18 checks on 2 different days. Its best position was #1 of 30, reached on Oct 30, 07:28 UTC. It dropped off the list after Oct 30, 13:28 UTC.