A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 14:45 UTC
fix: hyperlink (#16778)
Signed-off-by: reidliu41 <reid201711@gmail.com> Co-authored-by: reidliu41 <reid201711@gmail.com>
Reid committed
Apr 17, 2025 at 19:34 UTC
c69bf4ee064741c1fa12ec74d20c97f7cdd67d9f
1 file changed
+2
-2
docs/source/deployment/frameworks/open-webui.md
+2
-2
@@ -2,7 +2,7 @@
2
3
# Open WebUI
4
5
-1. Install the (Docker)[https://docs.docker.com/engine/install/]
5
+1. Install the [Docker](https://docs.docker.com/engine/install/)
6
7
2. Start the vLLM server with the supported chat completion model, e.g.
8
@@ -10,7 +10,7 @@
10
vllm serve qwen/Qwen1.5-0.5B-Chat
11
```
12
13
-1. Start the (Open WebUI)[https://github.com/open-webui/open-webui] docker container (replace the vllm serve host and vllm serve port):
13
+1. Start the [Open WebUI](https://github.com/open-webui/open-webui) docker container (replace the vllm serve host and vllm serve port):
14
15
```console
16
docker run -d -p 3000:8080 \