This is the repository card of kernels community/vllm flash attn3 that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated. How to use Available functions flash attn combine flash attn func flash attn qkvpacked func flash attn varlen func flash attn with kvcache get scheduler metadata Benchmarks Benchmarking script is available for this kernel. Run kernels benchmark kernels community/vllm flash attn3 version 1 .
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy