A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 23:30 UTC
[V1][PP] Fix & Pin Ray version in requirements-cuda.txt (#13436)
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Woosuk Kwon committed
Feb 17, 2025 at 21:58 UTC
9915912f7f985594cc65258a67207de21fb476ce
1 file changed
+1
-1
requirements-cuda.txt
+1
-1
@@ -2,7 +2,7 @@
2
-r requirements-common.txt
3
4
# Dependencies for NVIDIA GPUs
5
-ray[default] >= 2.9
5
+ray[adag] == 2.41.0 # Required for pipeline parallelism in V1.
6
torch == 2.5.1
7
torchaudio==2.5.1
8
# These must be updated alongside torch