A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 20:45 UTC
[Doc] xpu backend requires running setvars.sh (#6393)
Robert Cohn committed
Jul 14, 2024 at 20:10 UTC
61e85dbad87cc1a0b2a838274a758012062747a6
1 file changed
+2
-1
docs/source/getting_started/xpu-installation.rst
+2
-1
@@ -40,12 +40,13 @@ Quick start using Dockerfile
40
Build from source
41
-----------------
42
43
-- First, install required driver and intel OneAPI 2024.1.
43
+- First, install required driver and intel OneAPI 2024.1 or later.
44
45
- Second, install Python packages for vLLM XPU backend building:
46
47
.. code-block:: console
48
49
+ $ source /opt/intel/oneapi/setvars.sh
50
$ pip install --upgrade pip
51
$ pip install -v -r requirements-xpu.txt
52