A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 03:00 UTC
[HotFix] [CI/Build] Minor fix for CPU backend CI (#3787)
bigPYJ1151 committed
Apr 2, 2024 at 13:50 UTC
77a6572aa5e752b28383768ffcd151cf93e3925f
1 file changed
+1
-1
.buildkite/run-cpu-test.sh
+1
-1
@@ -11,4 +11,4 @@ trap remove_docker_container EXIT
11
remove_docker_container
12
13
# Run the image and launch offline inference
14
-docker run --network host --env VLLM_CPU_KVCACHE_SPACE=1 --name cpu-check cpu-test python3 examples/offline_inference.py
14
+docker run --network host --env VLLM_CPU_KVCACHE_SPACE=1 --name cpu-test cpu-test python3 examples/offline_inference.py