About this paper
AB-Attention approximates dense video diffusion attention with high sparsity via intra-block clustering, weighted sampling, and fine-grained kernel gathering, improving fidelity and speed.
Video diffusion transformers generate high-quality videos, but the quadratic cost of 3D full attention dominates their inference. Dynamic block-sparse attention reduces this cost by computing exact attention only on key/value blocks selected from current activations. However, its fidelity degrades under aggressive sparsity: blocks are scored from coarse summaries or formed by costly global clustering, pruned blocks vanish from the softmax, and whole tiles are kept or dropped even when only a few of their keys matter. To address these limitations, we propose Accurate Block Attention (AB-Attention), a training-free method that accurately approximates dense attention at high sparsity. Its…
video diffusion transformers3D full attentiondynamic block-sparse attentionAB-AttentionIntra-Block Clustering SelectorInclusion-Probability Weightingtensor-core tiles
- Upvotes
- 7
- Authors
- 9
- Published
- Oct 29, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
AB-Attention: Accurate Block Attention for Accelerating Video Diffusion Transformers was first seen on Hugging Face · Daily papers on Nov 2, 2026. Since then it has appeared in 5 checks on 1 different day. Its best position was #26 of 30, reached on Nov 2, 15:28 UTC. It dropped off the list after Nov 2, 17:28 UTC.