A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 12:15 UTC
[CI] Uses Python 3.11 for TPU (#17359)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Aaron Pham committed
Apr 29, 2025 at 13:39 UTC
b37685afbb8fa8ac7530ae15db6a96e23a83281d
1 file changed
+1
requirements/tpu.txt
+1
@@ -9,6 +9,7 @@ wheel
9
jinja2>=3.1.6
10
ray[default]
11
ray[data]
12
+setuptools==78.1.0
13
14
# Install torch_xla
15
--pre