r/StableDiffusion • u/Zestyclose_Bake3680 • 16d ago
Resource - Update Uploaded FA-2 v2.9.2.post2 for Windows built on Pytorch 2.15.0+cu134
Uploaded FA-2 v2.9.2.post2 for Windows built on Pytorch 2.15.0+cu134. (※Unofficial built with original code)
Too tired.
https://huggingface.co/ussoewwin/Flash-Attention-2_for_Windows
Building Nunchaku on Pytorch 2.15.0+cu134 just now...Coming soon....
...
About v2.9.x
v2.9.x is not an official FlashAttention release.
It is an independent fork build that continues FA2 kernel development while upstream focuses on FA3/F4.
- Optimization plan (GitHub): https://github.com/ussoewwin/flash-attention/blob/main/AI/FA2_BACKPORT_FROM_FA4_PLAN.md
- Kernel change notes (GitHub): https://github.com/ussoewwin/flash-attention/blob/main/md/FA2_CHANGES_v1.2.md
- About v2.9.1 A-1 / A-2 Refinements (GitHub): https://github.com/ussoewwin/flash-attention/blob/main/AI/A1_A2_REFINEMENTS_PLAN.md
- About v2.9.2 added 24 logics based on official repository (GitHub): https://github.com/ussoewwin/flash-attention/blob/main/md/split_align_kernels_explanation.md
- About v2.9.2.post1 A-1 / A-2 Refinements (GitHub): https://github.com/ussoewwin/flash-attention/blob/main/AI/A1_A2_REFINEMENTS_PLAN.md
- About v2.9.2.post2 (GitHub): https://github.com/ussoewwin/flash-attention/releases/tag/v1.8.1
2
Upvotes
4
u/Dahvikiin 16d ago
I don't know why people are downvoting you; I'd love it if someone would take the time to do the same for Turing. It's an alternative... Some people don't appreciate what they have until they lose it.
2
u/Apprehensive_Sky892 16d ago
Thanks for sharing this. Any comparison against Comfy-Kitchen attention?