Trendoday

Beyond Answering: Learning to Speak First and Act in Streaming Video

Most AI assistants respond only when prompted, remaining silent even when events in the video stream offer meaningful opportunities for conversation. To move beyond purely user-driven interaction, we

  • Upvotes29
–Rank now
#1Peak rank
2Days on list
318Score · 7d
Nov 18, 2026First seen
Rank · 7 days

About this paper

AURA 2.0 is a streaming video large language model that can initiate conversations, call tools, and perform interactive visual grounding, with long-horizon memory and a three-stage training scheme for improved streaming interaction.

Most AI assistants respond only when prompted, remaining silent even when events in the video stream offer meaningful opportunities for conversation. To move beyond purely user-driven interaction, we present AURA 2.0, a streaming video large language model that introduces three core upgrades to AURA. The key advance is Model-Initiated Conversation (MIC), which enables the model to identify topics worth discussing in the evolving visual stream and initiate conversations at appropriate moments without a user query. Stream-Aware Tool Calling (SATC) lets the model act on what it sees by invoking external tools using the current visual and conversational context and incorporating returned…

streaming video large language modelModel-Initiated ConversationStream-Aware Tool CallingInteractive Visual Groundingvisual groundingframe-aligned bounding boxesstreaming interaction datasetthree-stage training schemeLong-Horizon Interaction Memorystreaming benchmarks
Upvotes
29
Authors
18
Published
Nov 15, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

Beyond Answering: Learning to Speak First and Act in Streaming Video was first seen on Hugging Face · Daily papers on Nov 18, 2026. Since then it has appeared in 12 checks on 2 different days. Its best position was #1 of 30, reached on Nov 19, 07:29 UTC. It dropped off the list after Nov 19, 07:29 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 09:2814:5820:2901:5907:29 Nov 18, 09:28 UTC · #8Nov 18, 11:28 UTC · #8Nov 18, 13:28 UTC · #7Nov 18, 15:28 UTC · #6Nov 18, 17:28 UTC · #6Nov 18, 19:28 UTC · #6Nov 18, 21:28 UTC · #6Nov 18, 23:28 UTC · #6Nov 19, 01:28 UTC · #6Nov 19, 03:28 UTC · #6Nov 19, 05:28 UTC · #3Nov 19, 07:29 UTC · #1

Last 14 days

Best rank per day (UTC).

Nov 9today

Metric history

Platform metric as reported by Hugging Face.

0122335 09:2814:5820:2901:5907:29 Nov 18, 09:28 UTC · 29Nov 18, 11:28 UTC · 32Nov 18, 13:28 UTC · 32Nov 18, 15:28 UTC · 32Nov 18, 17:28 UTC · 33Nov 18, 19:28 UTC · 33Nov 18, 21:28 UTC · 33Nov 18, 23:28 UTC · 33Nov 19, 01:28 UTC · 33Nov 19, 03:28 UTC · 35Nov 19, 05:28 UTC · 35Nov 19, 07:29 UTC · 35

Questions

Is Beyond Answering: Learning to Speak First and Act in Streaming Video trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Nov 19, 07:29 UTC, after 2 days of trending.

What is the highest rank Beyond Answering: Learning to Speak First and Act in Streaming Video reached?

#1 on Hugging Face · Daily papers, on Nov 19, 07:29 UTC. Trendoday checks this list every 120 minutes.

How long has Beyond Answering: Learning to Speak First and Act in Streaming Video been trending?

It was first seen on Nov 18, 2026 and has been on the list on 2 days (12 checks) since.