@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 112627e8b2
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 06:45 UTC

[Docs] Fix the code block's format in deploying_with_docker page (#1722)

Wen Sun committed Nov 20, 2023 at 17:22 UTC 112627e8b26ccbbee19d894c2c4c4d953970a6fd
1 file changed +1 -1
docs/source/serving/deploying_with_docker.rst
+1 -1
@@ -7,7 +7,7 @@ vLLM offers official docker image for deployment.
7 The image can be used to run OpenAI compatible server.
8 The image is available on Docker Hub as `vllm/vllm-openai <https://hub.docker.com/r/vllm/vllm-openai/tags>`_.
9
10 -... code-block:: console
10 +.. code-block:: console
11
12 $ docker run --runtime nvidia --gpus all \
13 -v ~/.cache/huggingface:/root/.cache/huggingface \