A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 05:45 UTC
[Kernel] Update vllm-flash-attn version (#10736)
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Woosuk Kwon committed
Nov 28, 2024 at 02:25 UTC
9a8bff028595d1c5c52bc225013908ca7a7b66d8
1 file changed
+1
-1
CMakeLists.txt
+1
-1
@@ -522,7 +522,7 @@ else()
522
FetchContent_Declare(
523
vllm-flash-attn
524
GIT_REPOSITORY https://github.com/vllm-project/flash-attention.git
525
- GIT_TAG 5259c586c403a4e4d8bf69973c159b40cc346fb9
525
+ GIT_TAG d886f88165702b3c7e7744502772cd98b06be9e1
526
GIT_PROGRESS TRUE
527
# Don't share the vllm-flash-attn build between build types
528
BINARY_DIR ${CMAKE_BINARY_DIR}/vllm-flash-attn