A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 06:45 UTC
[Docs] Fix the code block's format in deploying_with_docker page (#1722)
Wen Sun committed
Nov 20, 2023 at 17:22 UTC
112627e8b26ccbbee19d894c2c4c4d953970a6fd
1 file changed
+1
-1
docs/source/serving/deploying_with_docker.rst
+1
-1
@@ -7,7 +7,7 @@ vLLM offers official docker image for deployment.
7
The image can be used to run OpenAI compatible server.
8
The image is available on Docker Hub as `vllm/vllm-openai <https://hub.docker.com/r/vllm/vllm-openai/tags>`_.
9
10
-... code-block:: console
10
+.. code-block:: console
11
12
$ docker run --runtime nvidia --gpus all \
13
-v ~/.cache/huggingface:/root/.cache/huggingface \