A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 23:30 UTC
Pin Ray version to 2.40.0 (#13490)
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Woosuk Kwon committed
Feb 18, 2025 at 12:50 UTC
c8d70e2437feecdb3762ce17298df33439ae1bd1
1 file changed
+1
-1
requirements-cuda.txt
+1
-1
@@ -2,7 +2,7 @@
2
-r requirements-common.txt
3
4
# Dependencies for NVIDIA GPUs
5
-ray[adag] == 2.41.0 # Required for pipeline parallelism in V1.
5
+ray[adag] == 2.40.0 # Required for pipeline parallelism in V1.
6
torch == 2.5.1
7
torchaudio==2.5.1
8
# These must be updated alongside torch