Trendoday

Attention at Absolute Zero

Attention scores candidate supports of an answer, which we call witnesses, and reads the scores at a temperature. We build a higher-order attention layer whose state lives on pairs of items: for a pai

  • Upvotes3
–Rank now
#25Peak rank
1Days on list
31Score · 7d
Nov 19, 2026First seen
Rank · 7 days

About this paper

Attention scores candidate supports of an answer, which we call witnesses, and reads the scores at a temperature. We build a higher-order attention layer whose state lives on pairs of items: for a pair (a, b), each third item k is a witness judged through its legs (a, k) and (k, b). It reads witnesses at zero temperature, keeping the best and the number tied with it, passes on only bits comparing such counts, rebuilds its pair state from the input and these bits at every loop, and is trained from answers alone. Each choice removes one way soft attention fails at size: dispersed weight, unresolved gaps between learned scores, and a drifting soft state. In maximum retrieval it is right on at…

Upvotes
3
Authors
1
Published
Nov 17, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

Attention at Absolute Zero was first seen on Hugging Face · Daily papers on Nov 19, 2026. Since then it has appeared in 3 checks on 1 different day. Its best position was #25 of 30, reached on Nov 19, 09:29 UTC. It dropped off the list after Nov 19, 09:29 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 05:2806:2807:2908:2909:29 Nov 19, 05:28 UTC · #27Nov 19, 07:29 UTC · #26Nov 19, 09:29 UTC · #25

Last 14 days

Best rank per day (UTC).

Nov 9today

Metric history

Platform metric as reported by Hugging Face.

0123 05:2806:2807:2908:2909:29 Nov 19, 05:28 UTC · 3Nov 19, 07:29 UTC · 3Nov 19, 09:29 UTC · 3

Questions

Is Attention at Absolute Zero trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Nov 19, 09:29 UTC, after 1 day of trending.

What is the highest rank Attention at Absolute Zero reached?

#25 on Hugging Face · Daily papers, on Nov 19, 09:29 UTC. Trendoday checks this list every 120 minutes.

How long has Attention at Absolute Zero been trending?

It was first seen on Nov 19, 2026 and has been on the list on 1 day (3 checks) since.