A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 4, 05:00 UTC
Upgrade tpu-inference to v0.19.0 (#41844)
Signed-off-by: Johnny Yang <johnnyyang@google.com>
Johnny Yang committed
May 6, 2026 at 11:41 UTC
ca3e62d3363d3f8f5470b351ebfc48fa1826e687
1 file changed
+1
-1
requirements/tpu.txt
+1
-1
@@ -11,4 +11,4 @@ ray[default]
11
ray[data]
12
setuptools==78.1.0
13
nixl==0.3.0
14
-tpu-inference==0.18.0
14
+tpu-inference==0.19.0