About this paper
AURA 2.0 is a streaming video large language model that can initiate conversations, call tools, and perform interactive visual grounding, with long-horizon memory and a three-stage training scheme for improved streaming interaction.
Most AI assistants respond only when prompted, remaining silent even when events in the video stream offer meaningful opportunities for conversation. To move beyond purely user-driven interaction, we present AURA 2.0, a streaming video large language model that introduces three core upgrades to AURA. The key advance is Model-Initiated Conversation (MIC), which enables the model to identify topics worth discussing in the evolving visual stream and initiate conversations at appropriate moments without a user query. Stream-Aware Tool Calling (SATC) lets the model act on what it sees by invoking external tools using the current visual and conversational context and incorporating returned…
streaming video large language modelModel-Initiated ConversationStream-Aware Tool CallingInteractive Visual Groundingvisual groundingframe-aligned bounding boxesstreaming interaction datasetthree-stage training schemeLong-Horizon Interaction Memorystreaming benchmarks
- Upvotes
- 29
- Authors
- 18
- Published
- Nov 15, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Beyond Answering: Learning to Speak First and Act in Streaming Video was first seen on Hugging Face · Daily papers on Nov 18, 2026. Since then it has appeared in 12 checks on 2 different days. Its best position was #1 of 30, reached on Nov 19, 07:29 UTC. It dropped off the list after Nov 19, 07:29 UTC.