This is the repository card of kernels community/flash attn2 that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated. How to use Available functions flash attn func flash attn kvpacked func flash attn qkvpacked func flash attn varlen func flash attn varlen kvpacked func flash attn varlen qkvpacked func flash attn with kvcache fwd varlen fwd bwd varlen bwd fwd kvcache Benchmarks Benchmarking script is available for this kernel. Run kernels benchmark kernels community/flash attn2 version 2 .
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy