A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 21:00 UTC
[Doc] Source building add clone step (#14086)
Signed-off-by: qux-bbb <1147635419@qq.com>
qux-bbb committed
Mar 2, 2025 at 18:59 UTC
bc6ccb987877000ec271e0076317b03a66cde4bc
1 file changed
+8
-1
docs/source/getting_started/installation/cpu/build.inc.md
+8
-1
@@ -6,7 +6,14 @@ sudo apt-get install -y gcc-12 g++-12 libnuma-dev
6
sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-12 10 --slave /usr/bin/g++ g++ /usr/bin/g++-12
7
```
8
9
-Second, install Python packages for vLLM CPU backend building:
9
+Second, clone vLLM project:
10
+
11
+```console
12
+git clone https://github.com/vllm-project/vllm.git vllm_source
13
+cd vllm_source
14
+```
15
+
16
+Third, install Python packages for vLLM CPU backend building:
17
18
```console
19
pip install --upgrade pip