A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 07:00 UTC
[CI/Build] Fix IDC hpu [Device not found] issue (#10384)
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Chendi.Xue committed
Nov 17, 2024 at 00:58 UTC
905d0f0af4e2c07893e36778da9ab02bde01ace8
1 file changed
+1
-1
.buildkite/run-hpu-test.sh
+1
-1
@@ -13,4 +13,4 @@ trap remove_docker_container EXIT
13
remove_docker_container
14
15
# Run the image and launch offline inference
16
-docker run --runtime=habana --name=hpu-test --network=host -e VLLM_SKIP_WARMUP=true --entrypoint="" hpu-test-env python3 examples/offline_inference.py
\ No newline at end of file
16
+docker run --runtime=habana --name=hpu-test --network=host -e HABANA_VISIBLE_DEVICES=all -e VLLM_SKIP_WARMUP=true --entrypoint="" hpu-test-env python3 examples/offline_inference.py
\ No newline at end of file