A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 14, 05:30 UTC
Install tpu_info==0.4.0 to fix core dump for TPU (#23135)
Xiang Xu committed
Aug 18, 2025 at 16:23 UTC
498259ccce7fd9ad5c767fd0bbc5a70fb456b836
1 file changed
+1
requirements/tpu.txt
+1
@@ -11,6 +11,7 @@ ray[default]
11
ray[data]
12
setuptools==78.1.0
13
nixl==0.3.0
14
+tpu_info==0.4.0
15
16
# Install torch_xla
17
--pre