A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 13:30 UTC
[Doc] mention how to install in CPU editable mode (#16923)
Signed-off-by: David Xia <david@davidxia.com>
David Xia committed
Apr 21, 2025 at 13:45 UTC
f728ab8e3578c22b42ed53e51b5e8ec35328d8b9
1 file changed
+6
docs/source/getting_started/installation/cpu/build.inc.md
+6
@@ -26,3 +26,9 @@ Finally, build and install vLLM CPU backend:
26
```console
27
VLLM_TARGET_DEVICE=cpu python setup.py install
28
```
29
+
30
+If you want to develop vllm, install it in editable mode instead.
31
+
32
+```console
33
+VLLM_TARGET_DEVICE=cpu python setup.py develop
34
+```