| --- |
| language: |
| - en |
| --- |
| |
| Windows |
| | Prebuilt Wheels | Python Versions | PyTorch Versions | CUDA Versions | Source | |
| |------------------------------------------------|-----------------|------------------|----------------|---------------------------------------------------------------------------| |
| | [Flash-Attention 2.7.4.post1](./flash_attn-2.7.4.post1-cp312-cp312-win_amd64.whl) | 3.12 | 2.8.0.dev | 12.8.1 | [Dao-AILab/flash-attention](https://github.com/Dao-AILab/flash-attention) | |
| | [SageAttention2.2.0](./sageattention-2.2.0-cp312-cp312-win_amd64.whl) | 3.12 | 2.9.0.dev | 12.9.1 | [thu-ml/SageAttention](https://github.com/thu-ml/SageAttention) or [jt-zhang/SageAttention2_plus](https://huggingface.co/jt-zhang/SageAttention2_plus) | |
| | SageAttention3 (pending approval) | 3.12 | 2.9.0.dev | 12.9.1 | [jt-zhang/SageAttention3](https://huggingface.co/jt-zhang/SageAttention3) | |
| | Flash-Attention_2.8.1 | 3.12 | 2.9.0.dev | 12.9.1 | [Dao-AILab/flash-attention](https://github.com/Dao-AILab/flash-attention) | |
| | xformers_0.0.31.post1 | 3.12 | 2.9.0.dev | 12.9.1 | [facebookresearch/xformers](https://github.com/facebookresearch/xformers) | |
| | INSERT | INSERT | INSERT | INSERT | INSERT | |
|
|
| Linux |
| | Prebuilt Wheels | Python Versions | PyTorch Versions | CUDA Versions | Source | |
| |------------------------------------------------|-----------------|------------------|----------------|---------------------------------------------------------------------------| |
| | [SageAttention2.2.0](./sageattention-2.2.0-cp313-cp313-linux_x86_64.whl) | 3.13 | 2.14.0.dev | 13.2.1 | [thu-ml/SageAttention](https://github.com/thu-ml/SageAttention) or [jt-zhang/SageAttention2_plus](https://huggingface.co/jt-zhang/SageAttention2_plus) | |
| | INSERT | INSERT | INSERT | INSERT | INSERT | |
|
|
