@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 905d0f0af4
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 07:00 UTC

[CI/Build] Fix IDC hpu [Device not found] issue (#10384)

Signed-off-by: Chendi Xue <chendi.xue@intel.com>

Chendi.Xue committed Nov 17, 2024 at 00:58 UTC 905d0f0af4e2c07893e36778da9ab02bde01ace8
1 file changed +1 -1
.buildkite/run-hpu-test.sh
+1 -1
@@ -13,4 +13,4 @@ trap remove_docker_container EXIT
13 remove_docker_container
14
15 # Run the image and launch offline inference
16 -docker run --runtime=habana --name=hpu-test --network=host -e VLLM_SKIP_WARMUP=true --entrypoint="" hpu-test-env python3 examples/offline_inference.py
\ No newline at end of file
16 +docker run --runtime=habana --name=hpu-test --network=host -e HABANA_VISIBLE_DEVICES=all -e VLLM_SKIP_WARMUP=true --entrypoint="" hpu-test-env python3 examples/offline_inference.py
\ No newline at end of file