AI Potluck
Infrastructure / Compilers & Model Optimization

FlashAttention

Dao AI Lab

FlashAttention is the reference implementation of IO-aware exact attention, computing attention without materializing the full attention matrix and so cutting memory traffic rather than approximating the result. The repository carries FlashAttention and FlashAttention-2 alongside the papers describing them, with Hopper-specific kernels in a separate tree.

Verified 2026-08-18 via the GitHub API and the LICENSE body.

Openness

5 high confidence
5.0
license
BSD-3-Clause(OSI)
source
public
core-gated
ungated

BSD-3-Clause license body confirmed. The repository is public and unarchived and builds the whole product, and the README describes no paid tier, enterprise edition or license-gated build beside it, so source is public and the core ungated.

Adoption

3 high confidence
3.0

402,966 PyPI downloads of `flash-attn` in the trailing 30 days, which lands in the 100K-1M band of the software usage scale, level 3.

Capability

3 medium confidence
3.0

Banded on the category feature matrix as performance-critical kernel and operator library. Placed two bands below the apache-tvm anchor, on a matrix that bands on how much of the model-to-hardware transformation pipeline a product performs, over how many inputs and targets.

Verified 2026-08-18