Back to Gap Map Infrastructure / Compilers & Model Optimization

Block Sparse Attention

MIT HAN Lab
open source / Overall score: 1.5

Block Sparse Attention is a library of sparse attention kernels from MIT HAN Lab supporting streaming attention at token and block granularity plus block-sparse attention, modified from FlashAttention to reduce the compute and memory cost of long-context LLM inference.

Openness

5 high confidence
5.0
license
BSD-3-Clause(OSI)
source
public
core features withheld
no

BSD-3-Clause license body confirmed. The repository is public and unarchived and builds the whole product, and the README describes no paid tier, enterprise edition or license-gated build beside it, so source is public and the core ungated.

Adoption

1 low confidence
1.0

Block Sparse Attention has no registry package and installs from source, so GitHub stars are the only adoption signal available. A star is not a use.

Capability

2 medium confidence
2.0

Block Sparse Attention supplies a handful of sparse-pattern attention kernel variants built on top of FlashAttention, rather than the general attention coverage a broader library would need. That narrow kernel set puts it two steps below TensorRT.

Verified 2026-09-27