A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 17:15 UTC
[Doc] update --system for transformers installation in docker doc (#15616)
Signed-off-by: reidliu41 <reid201711@gmail.com> Co-authored-by: reidliu41 <reid201711@gmail.com>
Reid committed
Mar 27, 2025 at 20:38 UTC
8063dfc61a0cbb348d4b1baf4b6e03e8ebae7cfa
1 file changed
+3
-3
docs/source/deployment/docker.md
+3
-3
@@ -34,11 +34,11 @@ If you need to use those dependencies (having accepted the license terms),
34
create a custom Dockerfile on top of the base image with an extra layer that installs them:
35
36
```Dockerfile
37
-FROM vllm/vllm-openai:v0.8.0
37
+FROM vllm/vllm-openai:v0.8.2
38
39
# e.g. install the `audio` and `video` optional dependencies
40
# NOTE: Make sure the version of vLLM matches the base image!
41
-RUN uv pip install vllm[audio,video]==0.8.0
41
+RUN uv pip install --system vllm[audio,video]==0.8.2
42
```
43
44
:::
@@ -52,7 +52,7 @@ with an extra layer that installs their code from source:
52
```Dockerfile
53
FROM vllm/vllm-openai:latest
54
55
-RUN uv pip install git+https://github.com/huggingface/transformers.git
55
+RUN uv pip install --system git+https://github.com/huggingface/transformers.git
56
```
57
58
:::