@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 77a6572aa5
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 03:00 UTC

[HotFix] [CI/Build] Minor fix for CPU backend CI (#3787)

bigPYJ1151 committed Apr 2, 2024 at 13:50 UTC 77a6572aa5e752b28383768ffcd151cf93e3925f
1 file changed +1 -1
.buildkite/run-cpu-test.sh
+1 -1
@@ -11,4 +11,4 @@ trap remove_docker_container EXIT
11 remove_docker_container
12
13 # Run the image and launch offline inference
14 -docker run --network host --env VLLM_CPU_KVCACHE_SPACE=1 --name cpu-check cpu-test python3 examples/offline_inference.py
14 +docker run --network host --env VLLM_CPU_KVCACHE_SPACE=1 --name cpu-test cpu-test python3 examples/offline_inference.py