WRSWorld Research StateContribute
WORLD RESEARCH STATE

Dao: FlashAttention-2 GPU work partitioning

Contribution grade

Efficient neural-network computation · Human-designed research method or resource

Reference score120,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Reorganized exact-attention work across GPU blocks and warps and reduced non-matrix-multiplication operations to improve accelerator utilization.

Scientific scope

Reorganized exact-attention work across GPU blocks and warps and reduced non-matrix-multiplication operations to improve accelerator utilization. Year follows the 2023 preprint; later conference publication is not a second result. This is a distinct work-partitioning refinement of FlashAttention, with measured gains tied to the tested GPU.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Year follows the 2023 preprint; later conference publication is not a second result. This is a distinct work-partitioning refinement of FlashAttention, with measured gains tied to the tested GPU.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction