A streaming speaker-diarization method removes the fixed speaker-slot limit by clustering speaker embeddings within slots after all slots are used, allowing unlimited speakers and efficient large-scale linking.
Meetings last up to an hour, and nobody knows in advance how many people will speak. Neural diarizers with a fixed number of output slots, such as Streaming Sortformer and Nemotron-3, are accurate and run online, but they cannot name more speakers than they have slots. We remove this limit without retraining. The slot head keeps deciding who is active and when speech overlaps, and speaker embeddings are clustered inside a single slot, with the official e-means algorithm, only after every slot has been used. In the streaming system, re-clustering is confined to a bounded window, labels are revised for a few seconds, and identities are anchored to the slots of the head. The resulting system…
neural diarizersStreaming SortformerNemotron-3output slotsslot headspeaker embeddingse-means algorithmstreaming diarizationre-clusteringbounded window
- Upvotes
- 9
- Authors
- 5
- Published
- Nov 13, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.