Trendoday

UniSpark: Exploring Hybrid Attention for Multimodal Understanding and Generation

We present UniSpark-9B, a unified multimodal model that investigates hybrid attention for visual understanding and generation. Built on a Mixture-of-Transformer-Experts backbone with approximately 9B

  • Upvotes7
#18Rank now 1
#17Peak rank
4Days on list
258Score · 7d
Nov 13, 2026First seen
Rank · 7 days

About this paper

We present UniSpark-9B, a unified multimodal model that investigates hybrid attention for visual understanding and generation. Built on a Mixture-of-Transformer-Experts backbone with approximately 9B parameters in each branch, UniSpark combines full attention for explicit token interactions with GatedDeltaNet linear attention for compact context propagation. Autoregressive text prediction and visual flow matching jointly support visual question answering, text-to-image generation, instruction-guided editing, and interleaved text-image prediction. In interleaved generation, noisy visual targets are isolated from subsequent predictions, while clean visual representations provide context for…

Upvotes
7
Authors
10
Published
Nov 12, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

UniSpark: Exploring Hybrid Attention for Multimodal Understanding and Generation was first seen on Hugging Face · Daily papers on Nov 13, 2026. Since then it has appeared in 36 checks on 4 different days. Its best position was #17 of 30, reached on Nov 13, 23:28 UTC. It is #18 right now, holding steady at #18 over the last 6 checks.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 Nov 13Nov 14Nov 14Nov 15Nov 16 Nov 13, 07:28 UTC · #26Nov 13, 09:28 UTC · #24Nov 13, 11:28 UTC · #23Nov 13, 13:28 UTC · #22Nov 13, 15:28 UTC · #22Nov 13, 17:28 UTC · #19Nov 13, 19:28 UTC · #19Nov 13, 21:28 UTC · #18Nov 13, 23:28 UTC · #17Nov 14, 01:28 UTC · #17Nov 14, 03:28 UTC · #18Nov 14, 05:28 UTC · #18Nov 14, 07:28 UTC · #19Nov 14, 09:28 UTC · #19Nov 14, 11:28 UTC · #19Nov 14, 13:28 UTC · #19Nov 14, 15:28 UTC · #19Nov 14, 17:28 UTC · #19Nov 14, 19:28 UTC · #19Nov 14, 21:28 UTC · #19Nov 14, 23:28 UTC · #19Nov 15, 01:28 UTC · #19Nov 15, 03:28 UTC · #19Nov 15, 05:28 UTC · #19Nov 15, 07:28 UTC · #19Nov 15, 09:28 UTC · #19Nov 15, 11:28 UTC · #18Nov 15, 13:28 UTC · #18Nov 15, 15:28 UTC · #18Nov 15, 17:28 UTC · #18Nov 15, 19:28 UTC · #18Nov 15, 21:28 UTC · #18Nov 15, 23:28 UTC · #19Nov 16, 01:28 UTC · #19Nov 16, 03:28 UTC · #17Nov 16, 05:28 UTC · #18

Last 14 days

Best rank per day (UTC).

Nov 3today

Metric history

▲ as reported by Hugging Face.

04913 Nov 13Nov 14Nov 14Nov 15Nov 16 Nov 13, 07:28 UTC · 7Nov 13, 09:28 UTC · 8Nov 13, 11:28 UTC · 8Nov 13, 13:28 UTC · 12Nov 13, 15:28 UTC · 12Nov 13, 17:28 UTC · 12Nov 13, 19:28 UTC · 12Nov 13, 21:28 UTC · 12Nov 13, 23:28 UTC · 12Nov 14, 01:28 UTC · 12Nov 14, 03:28 UTC · 12Nov 14, 05:28 UTC · 12Nov 14, 07:28 UTC · 12Nov 14, 09:28 UTC · 12Nov 14, 11:28 UTC · 12Nov 14, 13:28 UTC · 12Nov 14, 15:28 UTC · 12Nov 14, 17:28 UTC · 12Nov 14, 19:28 UTC · 12Nov 14, 21:28 UTC · 12Nov 14, 23:28 UTC · 12Nov 15, 01:28 UTC · 12Nov 15, 03:28 UTC · 12Nov 15, 05:28 UTC · 12Nov 15, 07:28 UTC · 12Nov 15, 09:28 UTC · 12Nov 15, 11:28 UTC · 13Nov 15, 13:28 UTC · 13Nov 15, 15:28 UTC · 13Nov 15, 17:28 UTC · 13Nov 15, 19:28 UTC · 13Nov 15, 21:28 UTC · 13Nov 15, 23:28 UTC · 13Nov 16, 01:28 UTC · 13Nov 16, 03:28 UTC · 13Nov 16, 05:28 UTC · 13

Questions

Is UniSpark: Exploring Hybrid Attention for Multimodal Understanding and Generation trending on HF Daily Papers right now?

Yes. As of Nov 16, 05:28 UTC it is #18, holding steady at #18 over the last 6 checks.

What is the highest rank UniSpark: Exploring Hybrid Attention for Multimodal Understanding and Generation reached?

#17 on Hugging Face · Daily papers, on Nov 13, 23:28 UTC. Trendoday checks this list every 120 minutes.

How long has UniSpark: Exploring Hybrid Attention for Multimodal Understanding and Generation been trending?

It was first seen on Nov 13, 2026 and has been on the list on 4 days (36 checks) since.