A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 18:30 UTC
[Doc] Update tip info on using latest transformers when creating a custom Dockerfile (#15070)
Marc-Alexandre Côté committed
Mar 19, 2025 at 09:33 UTC
073d1ed354902a99c788d1a834198a7653b4a256
1 file changed
+3
-3
docs/source/deployment/docker.md
+3
-3
@@ -34,11 +34,11 @@ If you need to use those dependencies (having accepted the license terms),
34
create a custom Dockerfile on top of the base image with an extra layer that installs them:
35
36
```Dockerfile
37
-FROM vllm/vllm-openai:v0.7.3
37
+FROM vllm/vllm-openai:v0.8.0
38
39
# e.g. install the `audio` and `video` optional dependencies
40
# NOTE: Make sure the version of vLLM matches the base image!
41
-RUN uv pip install --system vllm[audio,video]==0.7.3
41
+RUN uv pip install vllm[audio,video]==0.8.0
42
```
43
44
:::
@@ -52,7 +52,7 @@ with an extra layer that installs their code from source:
52
```Dockerfile
53
FROM vllm/vllm-openai:latest
54
55
-RUN uv pip install --system git+https://github.com/huggingface/transformers.git
55
+RUN uv pip install git+https://github.com/huggingface/transformers.git
56
```
57
58
:::