AI Potluck
Infrastructure / Compilers & Model Optimization

Flash Sparse Attention

HKUST(GZ) Data Intelligence and Analytics Lab (DIAL)

Flash-Sparse-Attention is a trainable sparse attention kernel library from HKUST(GZ)'s Data Intelligence and Analytics Lab, combining Flash Attention's memory efficiency with sparse and gated attention for long-sequence Transformer training and inference, including grouped-query attention, paged attention and fused-quant low-precision computation.

Verified 2026-09-02 via the GitHub API and the LICENSE body.

Openness

5 high confidence
5.0
license
BSD-3-Clause(OSI)
source
public
core-gated
ungated

BSD-3-Clause license body confirmed. The repository is public and unarchived and builds the whole product, and the README describes no paid tier, enterprise edition or license-gated build beside it, so source is public and the core ungated.

Adoption

1 high confidence
1.0

64 PyPI downloads of `flash-sparse-attn` in the trailing 30 days, which lands in the <10K band of the software usage scale, level 1. The package is published from HKUSTDial/flash-sparse-attention and `pip install flash-sparse-attn` is the README's install path.

Capability

3 medium confidence
3.0

Banded on the category feature matrix as one optimization family, applied broadly - the same shape as flash-attention, whose feature breadth (dense/sparse/gated variants, GQA/MQA, paged attention) it matches rather than narrowing to one model's attention variant. Placed two bands below the apache-tvm anchor.

  • https://github.com/HKUSTDial/flash-sparse-attention/blob/main/README.md recorded 2026-09-02

    README describes Flash-Sparse-Attention as a high-performance trainable sparse attention implementation supporting dense, sparse and gated attention, GQA/MQA, paged attention and fused low-precision quantization, with no paid tier, enterprise edition or license-gated build beside the published source.

Verified 2026-09-02