Trendoday

Out of Sight, Still in Mind: Token Compression for Omni-LLMs

The goal of this paper is to reduce the input token cost of Omni-modal large language models (Omni-LLMs) at inference time. Omni-LLMs reason jointly over audio, video and text, but the cost of the thr

  • Upvotes3
–Rank now
#28Peak rank
1Days on list
13Score · 7d
Nov 19, 2026First seen
Rank · 7 days

About this paper

ReMo, a training-free method, reduces inference input token cost for omni-modal large language models by compressing redundant visual tokens through cross-modal alignment and replacing object-level visual tokens with compact text descriptions, achieving comparable accuracy on audio-visual tasks.

The goal of this paper is to reduce the input token cost of Omni-modal large language models (Omni-LLMs) at inference time. Omni-LLMs reason jointly over audio, video and text, but the cost of the three streams is highly unbalanced: visual tokens account for the vast majority of the input, and are highly redundant. In this paper, we propose ReMo, a training-free framework that compresses visual tokens by redistributing their information across modalities: a visual token is kept only if its information appears nowhere else. ReMo achieves this in two ways: (i) it aligns audio and video in a shared space via closed-form calibration, and removes visual tokens already explained by the audio or…

Omni-modal large language modelsOmni-LLMstraining-free frameworkvisual token compressioncross-modal information redistributionclosed-form calibrationaudio-video alignmentshared spaceobject-level visual tokenslightweight object detector
Upvotes
3
Authors
4
Published
Nov 17, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

Out of Sight, Still in Mind: Token Compression for Omni-LLMs was first seen on Hugging Face · Daily papers on Nov 19, 2026. Since then it has appeared in 2 checks on 1 different day. Its best position was #28 of 30, reached on Nov 19, 11:29 UTC. It dropped off the list after Nov 19, 13:29 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 11:2911:5912:2912:5913:29 Nov 19, 11:29 UTC · #28Nov 19, 13:29 UTC · #29

Last 14 days

Best rank per day (UTC).

Nov 9today

Metric history

Platform metric as reported by Hugging Face.

0123 11:2911:5912:2912:5913:29 Nov 19, 11:29 UTC · 3Nov 19, 13:29 UTC · 3

Questions

Is Out of Sight, Still in Mind: Token Compression for Omni-LLMs trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Nov 19, 13:29 UTC, after 1 day of trending.

What is the highest rank Out of Sight, Still in Mind: Token Compression for Omni-LLMs reached?

#28 on Hugging Face · Daily papers, on Nov 19, 11:29 UTC. Trendoday checks this list every 120 minutes.

How long has Out of Sight, Still in Mind: Token Compression for Omni-LLMs been trending?

It was first seen on Nov 19, 2026 and has been on the list on 1 day (2 checks) since.